3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1965 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 411
Associated Job Ids:
1966
DAG Visualization
digraph G { subgraph clusterstage_1965 { label="Stage 1965"; 20648 [labelType="html" label="SQLExecutionRDD [20648]<br>run at <unknown>:0"]; 20656 [labelType="html" label="SQLExecutionRDD [20656]<br>toJavaRDD at <unknown>:0"]; 20658 [labelType="html" label="PythonRDD [20658]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster46202 { label="MicroBatchScan"; 20644 [labelType="html" label="DataSourceRDD [20644]<br>run at <unknown>:0"]; 20645 [labelType="html" label="MapPartitionsRDD [20645]<br>run at <unknown>:0"]; } subgraph cluster46201 { label="Project"; 20646 [labelType="html" label="MapPartitionsRDD [20646]<br>run at <unknown>:0"]; } subgraph cluster46197 { label="WholeStageCodegen (1)"; 20647 [labelType="html" label="MapPartitionsRDD [20647]<br>run at <unknown>:0"]; } subgraph cluster46211 { label="WholeStageCodegen (1)"; 20649 [labelType="html" label="MapPartitionsRDD [20649]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46210 { label="Filter"; 20650 [labelType="html" label="MapPartitionsRDD [20650]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46209 { label="Project"; 20651 [labelType="html" label="MapPartitionsRDD [20651]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46206 { label="WholeStageCodegen (2)"; 20652 [labelType="html" label="MapPartitionsRDD [20652]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46205 { label="Project"; 20653 [labelType="html" label="MapPartitionsRDD [20653]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46204 { label="DeserializeToObject"; 20654 [labelType="html" label="MapPartitionsRDD [20654]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46203 { label="MapPartitions"; 20655 [labelType="html" label="MapPartitionsRDD [20655]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46213 { label="mapPartitions"; 20657 [labelType="html" label="MapPartitionsRDD [20657]<br>toJavaRDD at <unknown>:0"]; } } 20644->20645; 20645->20646; 20646->20647; 20647->20648; 20648->20649; 20649->20650; 20650->20651; 20651->20652; 20652->20653; 20653->20654; 20654->20655; 20655->20656; 20656->20657; 20657->20658; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time