3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 214 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 390
Associated Job Ids:
214
DAG Visualization
digraph G { subgraph clusterstage_214 { label="Stage 214"; 2251 [labelType="html" label="SQLExecutionRDD [2251]<br>run at <unknown>:0"]; 2259 [labelType="html" label="SQLExecutionRDD [2259]<br>toJavaRDD at <unknown>:0"]; 2261 [labelType="html" label="PythonRDD [2261]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster5034 { label="MicroBatchScan"; 2247 [labelType="html" label="DataSourceRDD [2247]<br>run at <unknown>:0"]; 2248 [labelType="html" label="MapPartitionsRDD [2248]<br>run at <unknown>:0"]; } subgraph cluster5033 { label="Project"; 2249 [labelType="html" label="MapPartitionsRDD [2249]<br>run at <unknown>:0"]; } subgraph cluster5029 { label="WholeStageCodegen (1)"; 2250 [labelType="html" label="MapPartitionsRDD [2250]<br>run at <unknown>:0"]; } subgraph cluster5043 { label="WholeStageCodegen (1)"; 2252 [labelType="html" label="MapPartitionsRDD [2252]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5042 { label="Filter"; 2253 [labelType="html" label="MapPartitionsRDD [2253]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5041 { label="Project"; 2254 [labelType="html" label="MapPartitionsRDD [2254]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5038 { label="WholeStageCodegen (2)"; 2255 [labelType="html" label="MapPartitionsRDD [2255]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5037 { label="Project"; 2256 [labelType="html" label="MapPartitionsRDD [2256]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5036 { label="DeserializeToObject"; 2257 [labelType="html" label="MapPartitionsRDD [2257]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5035 { label="MapPartitions"; 2258 [labelType="html" label="MapPartitionsRDD [2258]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5045 { label="mapPartitions"; 2260 [labelType="html" label="MapPartitionsRDD [2260]<br>toJavaRDD at <unknown>:0"]; } } 2247->2248; 2248->2249; 2249->2250; 2250->2251; 2251->2252; 2252->2253; 2253->2254; 2254->2255; 2255->2256; 2256->2257; 2257->2258; 2258->2259; 2259->2260; 2260->2261; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time