3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1247 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 448
Associated Job Ids:
1248
DAG Visualization
digraph G { subgraph clusterstage_1247 { label="Stage 1247"; 13109 [labelType="html" label="SQLExecutionRDD [13109]<br>run at <unknown>:0"]; 13117 [labelType="html" label="SQLExecutionRDD [13117]<br>toJavaRDD at <unknown>:0"]; 13119 [labelType="html" label="PythonRDD [13119]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster29329 { label="MicroBatchScan"; 13105 [labelType="html" label="DataSourceRDD [13105]<br>run at <unknown>:0"]; 13106 [labelType="html" label="MapPartitionsRDD [13106]<br>run at <unknown>:0"]; } subgraph cluster29328 { label="Project"; 13107 [labelType="html" label="MapPartitionsRDD [13107]<br>run at <unknown>:0"]; } subgraph cluster29324 { label="WholeStageCodegen (1)"; 13108 [labelType="html" label="MapPartitionsRDD [13108]<br>run at <unknown>:0"]; } subgraph cluster29338 { label="WholeStageCodegen (1)"; 13110 [labelType="html" label="MapPartitionsRDD [13110]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29337 { label="Filter"; 13111 [labelType="html" label="MapPartitionsRDD [13111]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29336 { label="Project"; 13112 [labelType="html" label="MapPartitionsRDD [13112]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29333 { label="WholeStageCodegen (2)"; 13113 [labelType="html" label="MapPartitionsRDD [13113]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29332 { label="Project"; 13114 [labelType="html" label="MapPartitionsRDD [13114]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29331 { label="DeserializeToObject"; 13115 [labelType="html" label="MapPartitionsRDD [13115]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29330 { label="MapPartitions"; 13116 [labelType="html" label="MapPartitionsRDD [13116]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29340 { label="mapPartitions"; 13118 [labelType="html" label="MapPartitionsRDD [13118]<br>toJavaRDD at <unknown>:0"]; } } 13105->13106; 13106->13107; 13107->13108; 13108->13109; 13109->13110; 13110->13111; 13111->13112; 13112->13113; 13113->13114; 13114->13115; 13115->13116; 13116->13117; 13117->13118; 13118->13119; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time