3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1346 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 510
Associated Job Ids:
1346
DAG Visualization
digraph G { subgraph clusterstage_1346 { label="Stage 1346"; 14137 [labelType="html" label="SQLExecutionRDD [14137]<br>run at <unknown>:0"]; 14145 [labelType="html" label="SQLExecutionRDD [14145]<br>toJavaRDD at <unknown>:0"]; 14147 [labelType="html" label="PythonRDD [14147]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster31636 { label="MicroBatchScan"; 14133 [labelType="html" label="DataSourceRDD [14133]<br>run at <unknown>:0"]; 14134 [labelType="html" label="MapPartitionsRDD [14134]<br>run at <unknown>:0"]; } subgraph cluster31635 { label="Project"; 14135 [labelType="html" label="MapPartitionsRDD [14135]<br>run at <unknown>:0"]; } subgraph cluster31631 { label="WholeStageCodegen (1)"; 14136 [labelType="html" label="MapPartitionsRDD [14136]<br>run at <unknown>:0"]; } subgraph cluster31645 { label="WholeStageCodegen (1)"; 14138 [labelType="html" label="MapPartitionsRDD [14138]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31644 { label="Filter"; 14139 [labelType="html" label="MapPartitionsRDD [14139]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31643 { label="Project"; 14140 [labelType="html" label="MapPartitionsRDD [14140]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31640 { label="WholeStageCodegen (2)"; 14141 [labelType="html" label="MapPartitionsRDD [14141]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31639 { label="Project"; 14142 [labelType="html" label="MapPartitionsRDD [14142]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31638 { label="DeserializeToObject"; 14143 [labelType="html" label="MapPartitionsRDD [14143]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31637 { label="MapPartitions"; 14144 [labelType="html" label="MapPartitionsRDD [14144]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31647 { label="mapPartitions"; 14146 [labelType="html" label="MapPartitionsRDD [14146]<br>toJavaRDD at <unknown>:0"]; } } 14133->14134; 14134->14135; 14135->14136; 14136->14137; 14137->14138; 14138->14139; 14139->14140; 14140->14141; 14141->14142; 14142->14143; 14143->14144; 14144->14145; 14145->14146; 14146->14147; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time