3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 479 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 472
Associated Job Ids:
480
DAG Visualization
digraph G { subgraph clusterstage_479 { label="Stage 479"; 5045 [labelType="html" label="SQLExecutionRDD [5045]<br>run at <unknown>:0"]; 5053 [labelType="html" label="SQLExecutionRDD [5053]<br>toJavaRDD at <unknown>:0"]; 5055 [labelType="html" label="PythonRDD [5055]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11281 { label="MicroBatchScan"; 5041 [labelType="html" label="DataSourceRDD [5041]<br>run at <unknown>:0"]; 5042 [labelType="html" label="MapPartitionsRDD [5042]<br>run at <unknown>:0"]; } subgraph cluster11280 { label="Project"; 5043 [labelType="html" label="MapPartitionsRDD [5043]<br>run at <unknown>:0"]; } subgraph cluster11276 { label="WholeStageCodegen (1)"; 5044 [labelType="html" label="MapPartitionsRDD [5044]<br>run at <unknown>:0"]; } subgraph cluster11290 { label="WholeStageCodegen (1)"; 5046 [labelType="html" label="MapPartitionsRDD [5046]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11289 { label="Filter"; 5047 [labelType="html" label="MapPartitionsRDD [5047]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11288 { label="Project"; 5048 [labelType="html" label="MapPartitionsRDD [5048]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11285 { label="WholeStageCodegen (2)"; 5049 [labelType="html" label="MapPartitionsRDD [5049]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11284 { label="Project"; 5050 [labelType="html" label="MapPartitionsRDD [5050]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11283 { label="DeserializeToObject"; 5051 [labelType="html" label="MapPartitionsRDD [5051]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11282 { label="MapPartitions"; 5052 [labelType="html" label="MapPartitionsRDD [5052]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11292 { label="mapPartitions"; 5054 [labelType="html" label="MapPartitionsRDD [5054]<br>toJavaRDD at <unknown>:0"]; } } 5041->5042; 5042->5043; 5043->5044; 5044->5045; 5045->5046; 5046->5047; 5047->5048; 5048->5049; 5049->5050; 5050->5051; 5051->5052; 5052->5053; 5053->5054; 5054->5055; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time