3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 552 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 547
Output Size / Records:
102.2 KiB / 547
Associated Job Ids:
552
DAG Visualization
digraph G { subgraph clusterstage_552 { label="Stage 552"; subgraph cluster12985 { label="MicroBatchScan"; 5801 [labelType="html" label="DataSourceRDD [5801]<br>start at NativeMethodAccessorImpl.java:0"]; 5802 [labelType="html" label="MapPartitionsRDD [5802]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster12984 { label="Project"; 5803 [labelType="html" label="MapPartitionsRDD [5803]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster12980 { label="WholeStageCodegen (1)"; 5804 [labelType="html" label="MapPartitionsRDD [5804]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster12979 { label="Project"; 5805 [labelType="html" label="MapPartitionsRDD [5805]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster12978 { label="Sort"; 5806 [labelType="html" label="MapPartitionsRDD [5806]<br>start at NativeMethodAccessorImpl.java:0"]; } } 5801->5802; 5802->5803; 5803->5804; 5804->5805; 5805->5806; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time