3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1881 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 449
Output Size / Records:
84.1 KiB / 449
Associated Job Ids:
1881
DAG Visualization
digraph G { subgraph clusterstage_1881 { label="Stage 1881"; subgraph cluster44205 { label="MicroBatchScan"; 19755 [labelType="html" label="DataSourceRDD [19755]<br>start at NativeMethodAccessorImpl.java:0"]; 19756 [labelType="html" label="MapPartitionsRDD [19756]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster44204 { label="Project"; 19757 [labelType="html" label="MapPartitionsRDD [19757]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster44200 { label="WholeStageCodegen (1)"; 19758 [labelType="html" label="MapPartitionsRDD [19758]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster44199 { label="Project"; 19759 [labelType="html" label="MapPartitionsRDD [19759]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster44198 { label="Sort"; 19760 [labelType="html" label="MapPartitionsRDD [19760]<br>start at NativeMethodAccessorImpl.java:0"]; } } 19755->19756; 19756->19757; 19757->19758; 19758->19759; 19759->19760; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time