3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1624 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 423
Output Size / Records:
81.0 KiB / 423
Associated Job Ids:
1625
DAG Visualization
digraph G { subgraph clusterstage_1624 { label="Stage 1624"; subgraph cluster38185 { label="MicroBatchScan"; 17068 [labelType="html" label="DataSourceRDD [17068]<br>start at NativeMethodAccessorImpl.java:0"]; 17069 [labelType="html" label="MapPartitionsRDD [17069]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster38184 { label="Project"; 17070 [labelType="html" label="MapPartitionsRDD [17070]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster38180 { label="WholeStageCodegen (1)"; 17071 [labelType="html" label="MapPartitionsRDD [17071]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster38179 { label="Project"; 17072 [labelType="html" label="MapPartitionsRDD [17072]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster38178 { label="Sort"; 17073 [labelType="html" label="MapPartitionsRDD [17073]<br>start at NativeMethodAccessorImpl.java:0"]; } } 17068->17069; 17069->17070; 17070->17071; 17071->17072; 17072->17073; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time