3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 210 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 470
Associated Job Ids:
210
DAG Visualization
digraph G { subgraph clusterstage_210 { label="Stage 210"; 2209 [labelType="html" label="SQLExecutionRDD [2209]<br>run at <unknown>:0"]; 2217 [labelType="html" label="SQLExecutionRDD [2217]<br>toJavaRDD at <unknown>:0"]; 2219 [labelType="html" label="PythonRDD [2219]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster4940 { label="MicroBatchScan"; 2205 [labelType="html" label="DataSourceRDD [2205]<br>run at <unknown>:0"]; 2206 [labelType="html" label="MapPartitionsRDD [2206]<br>run at <unknown>:0"]; } subgraph cluster4939 { label="Project"; 2207 [labelType="html" label="MapPartitionsRDD [2207]<br>run at <unknown>:0"]; } subgraph cluster4935 { label="WholeStageCodegen (1)"; 2208 [labelType="html" label="MapPartitionsRDD [2208]<br>run at <unknown>:0"]; } subgraph cluster4949 { label="WholeStageCodegen (1)"; 2210 [labelType="html" label="MapPartitionsRDD [2210]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4948 { label="Filter"; 2211 [labelType="html" label="MapPartitionsRDD [2211]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4947 { label="Project"; 2212 [labelType="html" label="MapPartitionsRDD [2212]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4944 { label="WholeStageCodegen (2)"; 2213 [labelType="html" label="MapPartitionsRDD [2213]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4943 { label="Project"; 2214 [labelType="html" label="MapPartitionsRDD [2214]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4942 { label="DeserializeToObject"; 2215 [labelType="html" label="MapPartitionsRDD [2215]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4941 { label="MapPartitions"; 2216 [labelType="html" label="MapPartitionsRDD [2216]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4951 { label="mapPartitions"; 2218 [labelType="html" label="MapPartitionsRDD [2218]<br>toJavaRDD at <unknown>:0"]; } } 2205->2206; 2206->2207; 2207->2208; 2208->2209; 2209->2210; 2210->2211; 2211->2212; 2212->2213; 2213->2214; 2214->2215; 2215->2216; 2216->2217; 2217->2218; 2218->2219; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time