3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 880 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 489
Associated Job Ids:
880
DAG Visualization
digraph G { subgraph clusterstage_880 { label="Stage 880"; 9244 [labelType="html" label="SQLExecutionRDD [9244]<br>run at <unknown>:0"]; 9252 [labelType="html" label="SQLExecutionRDD [9252]<br>toJavaRDD at <unknown>:0"]; 9254 [labelType="html" label="PythonRDD [9254]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20685 { label="MicroBatchScan"; 9240 [labelType="html" label="DataSourceRDD [9240]<br>run at <unknown>:0"]; 9241 [labelType="html" label="MapPartitionsRDD [9241]<br>run at <unknown>:0"]; } subgraph cluster20684 { label="Project"; 9242 [labelType="html" label="MapPartitionsRDD [9242]<br>run at <unknown>:0"]; } subgraph cluster20680 { label="WholeStageCodegen (1)"; 9243 [labelType="html" label="MapPartitionsRDD [9243]<br>run at <unknown>:0"]; } subgraph cluster20694 { label="WholeStageCodegen (1)"; 9245 [labelType="html" label="MapPartitionsRDD [9245]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20693 { label="Filter"; 9246 [labelType="html" label="MapPartitionsRDD [9246]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20692 { label="Project"; 9247 [labelType="html" label="MapPartitionsRDD [9247]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20689 { label="WholeStageCodegen (2)"; 9248 [labelType="html" label="MapPartitionsRDD [9248]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20688 { label="Project"; 9249 [labelType="html" label="MapPartitionsRDD [9249]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20687 { label="DeserializeToObject"; 9250 [labelType="html" label="MapPartitionsRDD [9250]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20686 { label="MapPartitions"; 9251 [labelType="html" label="MapPartitionsRDD [9251]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20696 { label="mapPartitions"; 9253 [labelType="html" label="MapPartitionsRDD [9253]<br>toJavaRDD at <unknown>:0"]; } } 9240->9241; 9241->9242; 9242->9243; 9243->9244; 9244->9245; 9245->9246; 9246->9247; 9247->9248; 9248->9249; 9249->9250; 9250->9251; 9251->9252; 9252->9253; 9253->9254; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time