3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1342 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 432
Output Size / Records:
93.3 KiB / 432
Associated Job Ids:
1342
DAG Visualization
digraph G { subgraph clusterstage_1342 { label="Stage 1342"; subgraph cluster31560 { label="MicroBatchScan"; 14096 [labelType="html" label="DataSourceRDD [14096]<br>start at NativeMethodAccessorImpl.java:0"]; 14100 [labelType="html" label="MapPartitionsRDD [14100]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster31559 { label="Project"; 14101 [labelType="html" label="MapPartitionsRDD [14101]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster31551 { label="WholeStageCodegen (1)"; 14107 [labelType="html" label="MapPartitionsRDD [14107]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster31550 { label="Project"; 14108 [labelType="html" label="MapPartitionsRDD [14108]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster31549 { label="Sort"; 14109 [labelType="html" label="MapPartitionsRDD [14109]<br>start at NativeMethodAccessorImpl.java:0"]; } } 14096->14100; 14100->14101; 14101->14107; 14107->14108; 14108->14109; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time