3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1865 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 428
Output Size / Records:
77.5 KiB / 428
Associated Job Ids:
1865
DAG Visualization
digraph G { subgraph clusterstage_1865 { label="Stage 1865"; subgraph cluster43829 { label="MicroBatchScan"; 19587 [labelType="html" label="DataSourceRDD [19587]<br>start at NativeMethodAccessorImpl.java:0"]; 19588 [labelType="html" label="MapPartitionsRDD [19588]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster43828 { label="Project"; 19589 [labelType="html" label="MapPartitionsRDD [19589]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster43823 { label="WholeStageCodegen (1)"; 19590 [labelType="html" label="MapPartitionsRDD [19590]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster43822 { label="Project"; 19591 [labelType="html" label="MapPartitionsRDD [19591]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster43821 { label="Sort"; 19592 [labelType="html" label="MapPartitionsRDD [19592]<br>start at NativeMethodAccessorImpl.java:0"]; } } 19587->19588; 19588->19589; 19589->19590; 19590->19591; 19591->19592; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time