3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1558 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 455
Associated Job Ids:
1559
DAG Visualization
digraph G { subgraph clusterstage_1558 { label="Stage 1558"; 16364 [labelType="html" label="SQLExecutionRDD [16364]<br>run at <unknown>:0"]; 16378 [labelType="html" label="SQLExecutionRDD [16378]<br>toJavaRDD at <unknown>:0"]; 16380 [labelType="html" label="PythonRDD [16380]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster36614 { label="MicroBatchScan"; 16360 [labelType="html" label="DataSourceRDD [16360]<br>run at <unknown>:0"]; 16361 [labelType="html" label="MapPartitionsRDD [16361]<br>run at <unknown>:0"]; } subgraph cluster36613 { label="Project"; 16362 [labelType="html" label="MapPartitionsRDD [16362]<br>run at <unknown>:0"]; } subgraph cluster36609 { label="WholeStageCodegen (1)"; 16363 [labelType="html" label="MapPartitionsRDD [16363]<br>run at <unknown>:0"]; } subgraph cluster36631 { label="WholeStageCodegen (1)"; 16371 [labelType="html" label="MapPartitionsRDD [16371]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36630 { label="Filter"; 16372 [labelType="html" label="MapPartitionsRDD [16372]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36629 { label="Project"; 16373 [labelType="html" label="MapPartitionsRDD [16373]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36626 { label="WholeStageCodegen (2)"; 16374 [labelType="html" label="MapPartitionsRDD [16374]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36625 { label="Project"; 16375 [labelType="html" label="MapPartitionsRDD [16375]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36624 { label="DeserializeToObject"; 16376 [labelType="html" label="MapPartitionsRDD [16376]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36623 { label="MapPartitions"; 16377 [labelType="html" label="MapPartitionsRDD [16377]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36633 { label="mapPartitions"; 16379 [labelType="html" label="MapPartitionsRDD [16379]<br>toJavaRDD at <unknown>:0"]; } } 16360->16361; 16361->16362; 16362->16363; 16363->16364; 16364->16371; 16371->16372; 16372->16373; 16373->16374; 16374->16375; 16375->16376; 16376->16377; 16377->16378; 16378->16379; 16379->16380; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time