3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 299 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 473
Associated Job Ids:
299
DAG Visualization
digraph G { subgraph clusterstage_299 { label="Stage 299"; 3133 [labelType="html" label="SQLExecutionRDD [3133]<br>run at <unknown>:0"]; 3147 [labelType="html" label="SQLExecutionRDD [3147]<br>toJavaRDD at <unknown>:0"]; 3149 [labelType="html" label="PythonRDD [3149]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster7008 { label="MicroBatchScan"; 3129 [labelType="html" label="DataSourceRDD [3129]<br>run at <unknown>:0"]; 3130 [labelType="html" label="MapPartitionsRDD [3130]<br>run at <unknown>:0"]; } subgraph cluster7007 { label="Project"; 3131 [labelType="html" label="MapPartitionsRDD [3131]<br>run at <unknown>:0"]; } subgraph cluster7003 { label="WholeStageCodegen (1)"; 3132 [labelType="html" label="MapPartitionsRDD [3132]<br>run at <unknown>:0"]; } subgraph cluster7025 { label="WholeStageCodegen (1)"; 3140 [labelType="html" label="MapPartitionsRDD [3140]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7024 { label="Filter"; 3141 [labelType="html" label="MapPartitionsRDD [3141]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7023 { label="Project"; 3142 [labelType="html" label="MapPartitionsRDD [3142]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7020 { label="WholeStageCodegen (2)"; 3143 [labelType="html" label="MapPartitionsRDD [3143]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7019 { label="Project"; 3144 [labelType="html" label="MapPartitionsRDD [3144]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7018 { label="DeserializeToObject"; 3145 [labelType="html" label="MapPartitionsRDD [3145]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7017 { label="MapPartitions"; 3146 [labelType="html" label="MapPartitionsRDD [3146]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7027 { label="mapPartitions"; 3148 [labelType="html" label="MapPartitionsRDD [3148]<br>toJavaRDD at <unknown>:0"]; } } 3129->3130; 3130->3131; 3131->3132; 3132->3133; 3133->3140; 3140->3141; 3141->3142; 3142->3143; 3143->3144; 3144->3145; 3145->3146; 3146->3147; 3147->3148; 3148->3149; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time