3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1308 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 416
Associated Job Ids:
1308
DAG Visualization
digraph G { subgraph clusterstage_1308 { label="Stage 1308"; 13738 [labelType="html" label="SQLExecutionRDD [13738]<br>run at <unknown>:0"]; 13746 [labelType="html" label="SQLExecutionRDD [13746]<br>toJavaRDD at <unknown>:0"]; 13748 [labelType="html" label="PythonRDD [13748]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30743 { label="MicroBatchScan"; 13734 [labelType="html" label="DataSourceRDD [13734]<br>run at <unknown>:0"]; 13735 [labelType="html" label="MapPartitionsRDD [13735]<br>run at <unknown>:0"]; } subgraph cluster30742 { label="Project"; 13736 [labelType="html" label="MapPartitionsRDD [13736]<br>run at <unknown>:0"]; } subgraph cluster30738 { label="WholeStageCodegen (1)"; 13737 [labelType="html" label="MapPartitionsRDD [13737]<br>run at <unknown>:0"]; } subgraph cluster30752 { label="WholeStageCodegen (1)"; 13739 [labelType="html" label="MapPartitionsRDD [13739]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30751 { label="Filter"; 13740 [labelType="html" label="MapPartitionsRDD [13740]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30750 { label="Project"; 13741 [labelType="html" label="MapPartitionsRDD [13741]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30747 { label="WholeStageCodegen (2)"; 13742 [labelType="html" label="MapPartitionsRDD [13742]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30746 { label="Project"; 13743 [labelType="html" label="MapPartitionsRDD [13743]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30745 { label="DeserializeToObject"; 13744 [labelType="html" label="MapPartitionsRDD [13744]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30744 { label="MapPartitions"; 13745 [labelType="html" label="MapPartitionsRDD [13745]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30754 { label="mapPartitions"; 13747 [labelType="html" label="MapPartitionsRDD [13747]<br>toJavaRDD at <unknown>:0"]; } } 13734->13735; 13735->13736; 13736->13737; 13737->13738; 13738->13739; 13739->13740; 13740->13741; 13741->13742; 13742->13743; 13743->13744; 13744->13745; 13745->13746; 13746->13747; 13747->13748; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time