3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1263 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 450
Associated Job Ids:
1263
DAG Visualization
digraph G { subgraph clusterstage_1263 { label="Stage 1263"; 13255 [labelType="html" label="SQLExecutionRDD [13255]<br>run at <unknown>:0"]; 13269 [labelType="html" label="SQLExecutionRDD [13269]<br>toJavaRDD at <unknown>:0"]; 13271 [labelType="html" label="PythonRDD [13271]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster29662 { label="MicroBatchScan"; 13251 [labelType="html" label="DataSourceRDD [13251]<br>run at <unknown>:0"]; 13252 [labelType="html" label="MapPartitionsRDD [13252]<br>run at <unknown>:0"]; } subgraph cluster29661 { label="Project"; 13253 [labelType="html" label="MapPartitionsRDD [13253]<br>run at <unknown>:0"]; } subgraph cluster29657 { label="WholeStageCodegen (1)"; 13254 [labelType="html" label="MapPartitionsRDD [13254]<br>run at <unknown>:0"]; } subgraph cluster29679 { label="WholeStageCodegen (1)"; 13262 [labelType="html" label="MapPartitionsRDD [13262]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29678 { label="Filter"; 13263 [labelType="html" label="MapPartitionsRDD [13263]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29677 { label="Project"; 13264 [labelType="html" label="MapPartitionsRDD [13264]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29674 { label="WholeStageCodegen (2)"; 13265 [labelType="html" label="MapPartitionsRDD [13265]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29673 { label="Project"; 13266 [labelType="html" label="MapPartitionsRDD [13266]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29672 { label="DeserializeToObject"; 13267 [labelType="html" label="MapPartitionsRDD [13267]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29671 { label="MapPartitions"; 13268 [labelType="html" label="MapPartitionsRDD [13268]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29681 { label="mapPartitions"; 13270 [labelType="html" label="MapPartitionsRDD [13270]<br>toJavaRDD at <unknown>:0"]; } } 13251->13252; 13252->13253; 13253->13254; 13254->13255; 13255->13262; 13262->13263; 13263->13264; 13264->13265; 13265->13266; 13266->13267; 13267->13268; 13268->13269; 13269->13270; 13270->13271; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time