3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1456 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 459
Associated Job Ids:
1456
DAG Visualization
digraph G { subgraph clusterstage_1456 { label="Stage 1456"; 15292 [labelType="html" label="SQLExecutionRDD [15292]<br>run at <unknown>:0"]; 15300 [labelType="html" label="SQLExecutionRDD [15300]<br>toJavaRDD at <unknown>:0"]; 15302 [labelType="html" label="PythonRDD [15302]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster34221 { label="MicroBatchScan"; 15288 [labelType="html" label="DataSourceRDD [15288]<br>run at <unknown>:0"]; 15289 [labelType="html" label="MapPartitionsRDD [15289]<br>run at <unknown>:0"]; } subgraph cluster34220 { label="Project"; 15290 [labelType="html" label="MapPartitionsRDD [15290]<br>run at <unknown>:0"]; } subgraph cluster34216 { label="WholeStageCodegen (1)"; 15291 [labelType="html" label="MapPartitionsRDD [15291]<br>run at <unknown>:0"]; } subgraph cluster34230 { label="WholeStageCodegen (1)"; 15293 [labelType="html" label="MapPartitionsRDD [15293]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34229 { label="Filter"; 15294 [labelType="html" label="MapPartitionsRDD [15294]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34228 { label="Project"; 15295 [labelType="html" label="MapPartitionsRDD [15295]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34225 { label="WholeStageCodegen (2)"; 15296 [labelType="html" label="MapPartitionsRDD [15296]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34224 { label="Project"; 15297 [labelType="html" label="MapPartitionsRDD [15297]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34223 { label="DeserializeToObject"; 15298 [labelType="html" label="MapPartitionsRDD [15298]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34222 { label="MapPartitions"; 15299 [labelType="html" label="MapPartitionsRDD [15299]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34232 { label="mapPartitions"; 15301 [labelType="html" label="MapPartitionsRDD [15301]<br>toJavaRDD at <unknown>:0"]; } } 15288->15289; 15289->15290; 15290->15291; 15291->15292; 15292->15293; 15293->15294; 15294->15295; 15295->15296; 15296->15297; 15297->15298; 15298->15299; 15299->15300; 15300->15301; 15301->15302; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time