3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2049 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 400
Associated Job Ids:
2050
DAG Visualization
digraph G { subgraph clusterstage_2049 { label="Stage 2049"; 21530 [labelType="html" label="SQLExecutionRDD [21530]<br>run at <unknown>:0"]; 21538 [labelType="html" label="SQLExecutionRDD [21538]<br>toJavaRDD at <unknown>:0"]; 21540 [labelType="html" label="PythonRDD [21540]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster48176 { label="MicroBatchScan"; 21526 [labelType="html" label="DataSourceRDD [21526]<br>run at <unknown>:0"]; 21527 [labelType="html" label="MapPartitionsRDD [21527]<br>run at <unknown>:0"]; } subgraph cluster48175 { label="Project"; 21528 [labelType="html" label="MapPartitionsRDD [21528]<br>run at <unknown>:0"]; } subgraph cluster48171 { label="WholeStageCodegen (1)"; 21529 [labelType="html" label="MapPartitionsRDD [21529]<br>run at <unknown>:0"]; } subgraph cluster48185 { label="WholeStageCodegen (1)"; 21531 [labelType="html" label="MapPartitionsRDD [21531]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48184 { label="Filter"; 21532 [labelType="html" label="MapPartitionsRDD [21532]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48183 { label="Project"; 21533 [labelType="html" label="MapPartitionsRDD [21533]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48180 { label="WholeStageCodegen (2)"; 21534 [labelType="html" label="MapPartitionsRDD [21534]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48179 { label="Project"; 21535 [labelType="html" label="MapPartitionsRDD [21535]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48178 { label="DeserializeToObject"; 21536 [labelType="html" label="MapPartitionsRDD [21536]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48177 { label="MapPartitions"; 21537 [labelType="html" label="MapPartitionsRDD [21537]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48187 { label="mapPartitions"; 21539 [labelType="html" label="MapPartitionsRDD [21539]<br>toJavaRDD at <unknown>:0"]; } } 21526->21527; 21527->21528; 21528->21529; 21529->21530; 21530->21531; 21531->21532; 21532->21533; 21533->21534; 21534->21535; 21535->21536; 21536->21537; 21537->21538; 21538->21539; 21539->21540; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time