3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1852 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 424
Output Size / Records:
82.9 KiB / 424
Associated Job Ids:
1852
DAG Visualization
digraph G { subgraph clusterstage_1852 { label="Stage 1852"; subgraph cluster43535 { label="MicroBatchScan"; 19451 [labelType="html" label="DataSourceRDD [19451]<br>start at NativeMethodAccessorImpl.java:0"]; 19452 [labelType="html" label="MapPartitionsRDD [19452]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster43534 { label="Project"; 19453 [labelType="html" label="MapPartitionsRDD [19453]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster43530 { label="WholeStageCodegen (1)"; 19454 [labelType="html" label="MapPartitionsRDD [19454]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster43529 { label="Project"; 19455 [labelType="html" label="MapPartitionsRDD [19455]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster43528 { label="Sort"; 19456 [labelType="html" label="MapPartitionsRDD [19456]<br>start at NativeMethodAccessorImpl.java:0"]; } } 19451->19452; 19452->19453; 19453->19454; 19454->19455; 19455->19456; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time