3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1089 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 534
Associated Job Ids:
1090
DAG Visualization
digraph G { subgraph clusterstage_1089 { label="Stage 1089"; 11450 [labelType="html" label="SQLExecutionRDD [11450]<br>run at <unknown>:0"]; 11458 [labelType="html" label="SQLExecutionRDD [11458]<br>toJavaRDD at <unknown>:0"]; 11460 [labelType="html" label="PythonRDD [11460]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster25616 { label="MicroBatchScan"; 11446 [labelType="html" label="DataSourceRDD [11446]<br>run at <unknown>:0"]; 11447 [labelType="html" label="MapPartitionsRDD [11447]<br>run at <unknown>:0"]; } subgraph cluster25615 { label="Project"; 11448 [labelType="html" label="MapPartitionsRDD [11448]<br>run at <unknown>:0"]; } subgraph cluster25611 { label="WholeStageCodegen (1)"; 11449 [labelType="html" label="MapPartitionsRDD [11449]<br>run at <unknown>:0"]; } subgraph cluster25625 { label="WholeStageCodegen (1)"; 11451 [labelType="html" label="MapPartitionsRDD [11451]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25624 { label="Filter"; 11452 [labelType="html" label="MapPartitionsRDD [11452]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25623 { label="Project"; 11453 [labelType="html" label="MapPartitionsRDD [11453]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25620 { label="WholeStageCodegen (2)"; 11454 [labelType="html" label="MapPartitionsRDD [11454]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25619 { label="Project"; 11455 [labelType="html" label="MapPartitionsRDD [11455]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25618 { label="DeserializeToObject"; 11456 [labelType="html" label="MapPartitionsRDD [11456]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25617 { label="MapPartitions"; 11457 [labelType="html" label="MapPartitionsRDD [11457]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25627 { label="mapPartitions"; 11459 [labelType="html" label="MapPartitionsRDD [11459]<br>toJavaRDD at <unknown>:0"]; } } 11446->11447; 11447->11448; 11448->11449; 11449->11450; 11450->11451; 11451->11452; 11452->11453; 11453->11454; 11454->11455; 11455->11456; 11456->11457; 11457->11458; 11458->11459; 11459->11460; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time