3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1620 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 439
Output Size / Records:
80.9 KiB / 439
Associated Job Ids:
1621
DAG Visualization
digraph G { subgraph clusterstage_1620 { label="Stage 1620"; subgraph cluster38091 { label="MicroBatchScan"; 17026 [labelType="html" label="DataSourceRDD [17026]<br>start at NativeMethodAccessorImpl.java:0"]; 17027 [labelType="html" label="MapPartitionsRDD [17027]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster38090 { label="Project"; 17028 [labelType="html" label="MapPartitionsRDD [17028]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster38086 { label="WholeStageCodegen (1)"; 17029 [labelType="html" label="MapPartitionsRDD [17029]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster38085 { label="Project"; 17030 [labelType="html" label="MapPartitionsRDD [17030]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster38084 { label="Sort"; 17031 [labelType="html" label="MapPartitionsRDD [17031]<br>start at NativeMethodAccessorImpl.java:0"]; } } 17026->17027; 17027->17028; 17028->17029; 17029->17030; 17030->17031; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time