3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 899 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 464
Associated Job Ids:
900
DAG Visualization
digraph G { subgraph clusterstage_899 { label="Stage 899"; 9455 [labelType="html" label="SQLExecutionRDD [9455]<br>run at <unknown>:0"]; 9463 [labelType="html" label="SQLExecutionRDD [9463]<br>toJavaRDD at <unknown>:0"]; 9465 [labelType="html" label="PythonRDD [9465]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster21151 { label="MicroBatchScan"; 9451 [labelType="html" label="DataSourceRDD [9451]<br>run at <unknown>:0"]; 9452 [labelType="html" label="MapPartitionsRDD [9452]<br>run at <unknown>:0"]; } subgraph cluster21150 { label="Project"; 9453 [labelType="html" label="MapPartitionsRDD [9453]<br>run at <unknown>:0"]; } subgraph cluster21146 { label="WholeStageCodegen (1)"; 9454 [labelType="html" label="MapPartitionsRDD [9454]<br>run at <unknown>:0"]; } subgraph cluster21160 { label="WholeStageCodegen (1)"; 9456 [labelType="html" label="MapPartitionsRDD [9456]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21159 { label="Filter"; 9457 [labelType="html" label="MapPartitionsRDD [9457]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21158 { label="Project"; 9458 [labelType="html" label="MapPartitionsRDD [9458]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21155 { label="WholeStageCodegen (2)"; 9459 [labelType="html" label="MapPartitionsRDD [9459]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21154 { label="Project"; 9460 [labelType="html" label="MapPartitionsRDD [9460]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21153 { label="DeserializeToObject"; 9461 [labelType="html" label="MapPartitionsRDD [9461]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21152 { label="MapPartitions"; 9462 [labelType="html" label="MapPartitionsRDD [9462]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21162 { label="mapPartitions"; 9464 [labelType="html" label="MapPartitionsRDD [9464]<br>toJavaRDD at <unknown>:0"]; } } 9451->9452; 9452->9453; 9453->9454; 9454->9455; 9455->9456; 9456->9457; 9457->9458; 9458->9459; 9459->9460; 9460->9461; 9461->9462; 9462->9463; 9463->9464; 9464->9465; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time