3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1272 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 399
Associated Job Ids:
1272
DAG Visualization
digraph G { subgraph clusterstage_1272 { label="Stage 1272"; 13360 [labelType="html" label="SQLExecutionRDD [13360]<br>run at <unknown>:0"]; 13368 [labelType="html" label="SQLExecutionRDD [13368]<br>toJavaRDD at <unknown>:0"]; 13370 [labelType="html" label="PythonRDD [13370]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster29897 { label="MicroBatchScan"; 13356 [labelType="html" label="DataSourceRDD [13356]<br>run at <unknown>:0"]; 13357 [labelType="html" label="MapPartitionsRDD [13357]<br>run at <unknown>:0"]; } subgraph cluster29896 { label="Project"; 13358 [labelType="html" label="MapPartitionsRDD [13358]<br>run at <unknown>:0"]; } subgraph cluster29892 { label="WholeStageCodegen (1)"; 13359 [labelType="html" label="MapPartitionsRDD [13359]<br>run at <unknown>:0"]; } subgraph cluster29906 { label="WholeStageCodegen (1)"; 13361 [labelType="html" label="MapPartitionsRDD [13361]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29905 { label="Filter"; 13362 [labelType="html" label="MapPartitionsRDD [13362]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29904 { label="Project"; 13363 [labelType="html" label="MapPartitionsRDD [13363]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29901 { label="WholeStageCodegen (2)"; 13364 [labelType="html" label="MapPartitionsRDD [13364]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29900 { label="Project"; 13365 [labelType="html" label="MapPartitionsRDD [13365]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29899 { label="DeserializeToObject"; 13366 [labelType="html" label="MapPartitionsRDD [13366]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29898 { label="MapPartitions"; 13367 [labelType="html" label="MapPartitionsRDD [13367]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29908 { label="mapPartitions"; 13369 [labelType="html" label="MapPartitionsRDD [13369]<br>toJavaRDD at <unknown>:0"]; } } 13356->13357; 13357->13358; 13358->13359; 13359->13360; 13360->13361; 13361->13362; 13362->13363; 13363->13364; 13364->13365; 13365->13366; 13366->13367; 13367->13368; 13368->13369; 13369->13370; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time