3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2026 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 444
Associated Job Ids:
2027
DAG Visualization
digraph G { subgraph clusterstage_2026 { label="Stage 2026"; 21278 [labelType="html" label="SQLExecutionRDD [21278]<br>run at <unknown>:0"]; 21286 [labelType="html" label="SQLExecutionRDD [21286]<br>toJavaRDD at <unknown>:0"]; 21294 [labelType="html" label="PythonRDD [21294]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47612 { label="MicroBatchScan"; 21274 [labelType="html" label="DataSourceRDD [21274]<br>run at <unknown>:0"]; 21275 [labelType="html" label="MapPartitionsRDD [21275]<br>run at <unknown>:0"]; } subgraph cluster47611 { label="Project"; 21276 [labelType="html" label="MapPartitionsRDD [21276]<br>run at <unknown>:0"]; } subgraph cluster47607 { label="WholeStageCodegen (1)"; 21277 [labelType="html" label="MapPartitionsRDD [21277]<br>run at <unknown>:0"]; } subgraph cluster47621 { label="WholeStageCodegen (1)"; 21279 [labelType="html" label="MapPartitionsRDD [21279]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47620 { label="Filter"; 21280 [labelType="html" label="MapPartitionsRDD [21280]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47619 { label="Project"; 21281 [labelType="html" label="MapPartitionsRDD [21281]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47616 { label="WholeStageCodegen (2)"; 21282 [labelType="html" label="MapPartitionsRDD [21282]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47615 { label="Project"; 21283 [labelType="html" label="MapPartitionsRDD [21283]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47614 { label="DeserializeToObject"; 21284 [labelType="html" label="MapPartitionsRDD [21284]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47613 { label="MapPartitions"; 21285 [labelType="html" label="MapPartitionsRDD [21285]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47623 { label="mapPartitions"; 21287 [labelType="html" label="MapPartitionsRDD [21287]<br>toJavaRDD at <unknown>:0"]; } } 21274->21275; 21275->21276; 21276->21277; 21277->21278; 21278->21279; 21279->21280; 21280->21281; 21281->21282; 21282->21283; 21283->21284; 21284->21285; 21285->21286; 21286->21287; 21287->21294; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time