3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1957 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 479
Associated Job Ids:
1958
DAG Visualization
digraph G { subgraph clusterstage_1957 { label="Stage 1957"; 20564 [labelType="html" label="SQLExecutionRDD [20564]<br>run at <unknown>:0"]; 20572 [labelType="html" label="SQLExecutionRDD [20572]<br>toJavaRDD at <unknown>:0"]; 20574 [labelType="html" label="PythonRDD [20574]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster46014 { label="MicroBatchScan"; 20560 [labelType="html" label="DataSourceRDD [20560]<br>run at <unknown>:0"]; 20561 [labelType="html" label="MapPartitionsRDD [20561]<br>run at <unknown>:0"]; } subgraph cluster46013 { label="Project"; 20562 [labelType="html" label="MapPartitionsRDD [20562]<br>run at <unknown>:0"]; } subgraph cluster46009 { label="WholeStageCodegen (1)"; 20563 [labelType="html" label="MapPartitionsRDD [20563]<br>run at <unknown>:0"]; } subgraph cluster46023 { label="WholeStageCodegen (1)"; 20565 [labelType="html" label="MapPartitionsRDD [20565]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46022 { label="Filter"; 20566 [labelType="html" label="MapPartitionsRDD [20566]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46021 { label="Project"; 20567 [labelType="html" label="MapPartitionsRDD [20567]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46018 { label="WholeStageCodegen (2)"; 20568 [labelType="html" label="MapPartitionsRDD [20568]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46017 { label="Project"; 20569 [labelType="html" label="MapPartitionsRDD [20569]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46016 { label="DeserializeToObject"; 20570 [labelType="html" label="MapPartitionsRDD [20570]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46015 { label="MapPartitions"; 20571 [labelType="html" label="MapPartitionsRDD [20571]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46025 { label="mapPartitions"; 20573 [labelType="html" label="MapPartitionsRDD [20573]<br>toJavaRDD at <unknown>:0"]; } } 20560->20561; 20561->20562; 20562->20563; 20563->20564; 20564->20565; 20565->20566; 20566->20567; 20567->20568; 20568->20569; 20569->20570; 20570->20571; 20571->20572; 20572->20573; 20573->20574; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time