3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2045 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 449
Output Size / Records:
82.8 KiB / 449
Associated Job Ids:
2046
DAG Visualization
digraph G { subgraph clusterstage_2045 { label="Stage 2045"; subgraph cluster48100 { label="MicroBatchScan"; 21489 [labelType="html" label="DataSourceRDD [21489]<br>start at NativeMethodAccessorImpl.java:0"]; 21490 [labelType="html" label="MapPartitionsRDD [21490]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster48099 { label="Project"; 21491 [labelType="html" label="MapPartitionsRDD [21491]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster48085 { label="WholeStageCodegen (1)"; 21492 [labelType="html" label="MapPartitionsRDD [21492]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster48084 { label="Project"; 21493 [labelType="html" label="MapPartitionsRDD [21493]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster48083 { label="Sort"; 21494 [labelType="html" label="MapPartitionsRDD [21494]<br>start at NativeMethodAccessorImpl.java:0"]; } } 21489->21490; 21490->21491; 21491->21492; 21492->21493; 21493->21494; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time