3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 412 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 484
Output Size / Records:
101.5 KiB / 484
Associated Job Ids:
412
DAG Visualization
digraph G { subgraph clusterstage_412 { label="Stage 412"; subgraph cluster9695 { label="MicroBatchScan"; 4331 [labelType="html" label="DataSourceRDD [4331]<br>start at NativeMethodAccessorImpl.java:0"]; 4332 [labelType="html" label="MapPartitionsRDD [4332]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster9694 { label="Project"; 4333 [labelType="html" label="MapPartitionsRDD [4333]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster9690 { label="WholeStageCodegen (1)"; 4334 [labelType="html" label="MapPartitionsRDD [4334]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster9689 { label="Project"; 4335 [labelType="html" label="MapPartitionsRDD [4335]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster9688 { label="Sort"; 4336 [labelType="html" label="MapPartitionsRDD [4336]<br>start at NativeMethodAccessorImpl.java:0"]; } } 4331->4332; 4332->4333; 4333->4334; 4334->4335; 4335->4336; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time