3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 878 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 440
Associated Job Ids:
878
DAG Visualization
digraph G { subgraph clusterstage_878 { label="Stage 878"; 9223 [labelType="html" label="SQLExecutionRDD [9223]<br>run at <unknown>:0"]; 9231 [labelType="html" label="SQLExecutionRDD [9231]<br>toJavaRDD at <unknown>:0"]; 9233 [labelType="html" label="PythonRDD [9233]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20638 { label="MicroBatchScan"; 9219 [labelType="html" label="DataSourceRDD [9219]<br>run at <unknown>:0"]; 9220 [labelType="html" label="MapPartitionsRDD [9220]<br>run at <unknown>:0"]; } subgraph cluster20637 { label="Project"; 9221 [labelType="html" label="MapPartitionsRDD [9221]<br>run at <unknown>:0"]; } subgraph cluster20633 { label="WholeStageCodegen (1)"; 9222 [labelType="html" label="MapPartitionsRDD [9222]<br>run at <unknown>:0"]; } subgraph cluster20647 { label="WholeStageCodegen (1)"; 9224 [labelType="html" label="MapPartitionsRDD [9224]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20646 { label="Filter"; 9225 [labelType="html" label="MapPartitionsRDD [9225]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20645 { label="Project"; 9226 [labelType="html" label="MapPartitionsRDD [9226]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20642 { label="WholeStageCodegen (2)"; 9227 [labelType="html" label="MapPartitionsRDD [9227]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20641 { label="Project"; 9228 [labelType="html" label="MapPartitionsRDD [9228]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20640 { label="DeserializeToObject"; 9229 [labelType="html" label="MapPartitionsRDD [9229]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20639 { label="MapPartitions"; 9230 [labelType="html" label="MapPartitionsRDD [9230]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20649 { label="mapPartitions"; 9232 [labelType="html" label="MapPartitionsRDD [9232]<br>toJavaRDD at <unknown>:0"]; } } 9219->9220; 9220->9221; 9221->9222; 9222->9223; 9223->9224; 9224->9225; 9225->9226; 9226->9227; 9227->9228; 9228->9229; 9229->9230; 9230->9231; 9231->9232; 9232->9233; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time