3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1803 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 430
Associated Job Ids:
1803
DAG Visualization
digraph G { subgraph clusterstage_1803 { label="Stage 1803"; 18925 [labelType="html" label="SQLExecutionRDD [18925]<br>run at <unknown>:0"]; 18939 [labelType="html" label="SQLExecutionRDD [18939]<br>toJavaRDD at <unknown>:0"]; 18941 [labelType="html" label="PythonRDD [18941]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster42352 { label="MicroBatchScan"; 18921 [labelType="html" label="DataSourceRDD [18921]<br>run at <unknown>:0"]; 18922 [labelType="html" label="MapPartitionsRDD [18922]<br>run at <unknown>:0"]; } subgraph cluster42351 { label="Project"; 18923 [labelType="html" label="MapPartitionsRDD [18923]<br>run at <unknown>:0"]; } subgraph cluster42347 { label="WholeStageCodegen (1)"; 18924 [labelType="html" label="MapPartitionsRDD [18924]<br>run at <unknown>:0"]; } subgraph cluster42369 { label="WholeStageCodegen (1)"; 18932 [labelType="html" label="MapPartitionsRDD [18932]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42368 { label="Filter"; 18933 [labelType="html" label="MapPartitionsRDD [18933]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42367 { label="Project"; 18934 [labelType="html" label="MapPartitionsRDD [18934]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42364 { label="WholeStageCodegen (2)"; 18935 [labelType="html" label="MapPartitionsRDD [18935]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42363 { label="Project"; 18936 [labelType="html" label="MapPartitionsRDD [18936]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42362 { label="DeserializeToObject"; 18937 [labelType="html" label="MapPartitionsRDD [18937]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42361 { label="MapPartitions"; 18938 [labelType="html" label="MapPartitionsRDD [18938]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42371 { label="mapPartitions"; 18940 [labelType="html" label="MapPartitionsRDD [18940]<br>toJavaRDD at <unknown>:0"]; } } 18921->18922; 18922->18923; 18923->18924; 18924->18925; 18925->18932; 18932->18933; 18933->18934; 18934->18935; 18935->18936; 18936->18937; 18937->18938; 18938->18939; 18939->18940; 18940->18941; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time