3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1241 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 427
Associated Job Ids:
1242
DAG Visualization
digraph G { subgraph clusterstage_1241 { label="Stage 1241"; 13046 [labelType="html" label="SQLExecutionRDD [13046]<br>run at <unknown>:0"]; 13054 [labelType="html" label="SQLExecutionRDD [13054]<br>toJavaRDD at <unknown>:0"]; 13056 [labelType="html" label="PythonRDD [13056]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster29188 { label="MicroBatchScan"; 13042 [labelType="html" label="DataSourceRDD [13042]<br>run at <unknown>:0"]; 13043 [labelType="html" label="MapPartitionsRDD [13043]<br>run at <unknown>:0"]; } subgraph cluster29187 { label="Project"; 13044 [labelType="html" label="MapPartitionsRDD [13044]<br>run at <unknown>:0"]; } subgraph cluster29183 { label="WholeStageCodegen (1)"; 13045 [labelType="html" label="MapPartitionsRDD [13045]<br>run at <unknown>:0"]; } subgraph cluster29197 { label="WholeStageCodegen (1)"; 13047 [labelType="html" label="MapPartitionsRDD [13047]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29196 { label="Filter"; 13048 [labelType="html" label="MapPartitionsRDD [13048]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29195 { label="Project"; 13049 [labelType="html" label="MapPartitionsRDD [13049]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29192 { label="WholeStageCodegen (2)"; 13050 [labelType="html" label="MapPartitionsRDD [13050]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29191 { label="Project"; 13051 [labelType="html" label="MapPartitionsRDD [13051]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29190 { label="DeserializeToObject"; 13052 [labelType="html" label="MapPartitionsRDD [13052]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29189 { label="MapPartitions"; 13053 [labelType="html" label="MapPartitionsRDD [13053]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29199 { label="mapPartitions"; 13055 [labelType="html" label="MapPartitionsRDD [13055]<br>toJavaRDD at <unknown>:0"]; } } 13042->13043; 13043->13044; 13044->13045; 13045->13046; 13046->13047; 13047->13048; 13048->13049; 13049->13050; 13050->13051; 13051->13052; 13052->13053; 13053->13054; 13054->13055; 13055->13056; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time