3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1032 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 463
Output Size / Records:
82.7 KiB / 463
Associated Job Ids:
1033
DAG Visualization
digraph G { subgraph clusterstage_1032 { label="Stage 1032"; subgraph cluster24273 { label="MicroBatchScan"; 10852 [labelType="html" label="DataSourceRDD [10852]<br>start at NativeMethodAccessorImpl.java:0"]; 10853 [labelType="html" label="MapPartitionsRDD [10853]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster24272 { label="Project"; 10854 [labelType="html" label="MapPartitionsRDD [10854]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster24268 { label="WholeStageCodegen (1)"; 10855 [labelType="html" label="MapPartitionsRDD [10855]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster24267 { label="Project"; 10856 [labelType="html" label="MapPartitionsRDD [10856]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster24266 { label="Sort"; 10857 [labelType="html" label="MapPartitionsRDD [10857]<br>start at NativeMethodAccessorImpl.java:0"]; } } 10852->10853; 10853->10854; 10854->10855; 10855->10856; 10856->10857; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time