3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1253 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 426
Associated Job Ids:
1254
DAG Visualization
digraph G { subgraph clusterstage_1253 { label="Stage 1253"; 13172 [labelType="html" label="SQLExecutionRDD [13172]<br>run at <unknown>:0"]; 13180 [labelType="html" label="SQLExecutionRDD [13180]<br>toJavaRDD at <unknown>:0"]; 13182 [labelType="html" label="PythonRDD [13182]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster29470 { label="MicroBatchScan"; 13168 [labelType="html" label="DataSourceRDD [13168]<br>run at <unknown>:0"]; 13169 [labelType="html" label="MapPartitionsRDD [13169]<br>run at <unknown>:0"]; } subgraph cluster29469 { label="Project"; 13170 [labelType="html" label="MapPartitionsRDD [13170]<br>run at <unknown>:0"]; } subgraph cluster29465 { label="WholeStageCodegen (1)"; 13171 [labelType="html" label="MapPartitionsRDD [13171]<br>run at <unknown>:0"]; } subgraph cluster29479 { label="WholeStageCodegen (1)"; 13173 [labelType="html" label="MapPartitionsRDD [13173]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29478 { label="Filter"; 13174 [labelType="html" label="MapPartitionsRDD [13174]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29477 { label="Project"; 13175 [labelType="html" label="MapPartitionsRDD [13175]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29474 { label="WholeStageCodegen (2)"; 13176 [labelType="html" label="MapPartitionsRDD [13176]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29473 { label="Project"; 13177 [labelType="html" label="MapPartitionsRDD [13177]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29472 { label="DeserializeToObject"; 13178 [labelType="html" label="MapPartitionsRDD [13178]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29471 { label="MapPartitions"; 13179 [labelType="html" label="MapPartitionsRDD [13179]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29481 { label="mapPartitions"; 13181 [labelType="html" label="MapPartitionsRDD [13181]<br>toJavaRDD at <unknown>:0"]; } } 13168->13169; 13169->13170; 13170->13171; 13171->13172; 13172->13173; 13173->13174; 13174->13175; 13175->13176; 13176->13177; 13177->13178; 13178->13179; 13179->13180; 13180->13181; 13181->13182; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time