3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 691 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 413
Associated Job Ids:
692
DAG Visualization
digraph G { subgraph clusterstage_691 { label="Stage 691"; 7271 [labelType="html" label="SQLExecutionRDD [7271]<br>run at <unknown>:0"]; 7279 [labelType="html" label="SQLExecutionRDD [7279]<br>toJavaRDD at <unknown>:0"]; 7281 [labelType="html" label="PythonRDD [7281]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16263 { label="MicroBatchScan"; 7267 [labelType="html" label="DataSourceRDD [7267]<br>run at <unknown>:0"]; 7268 [labelType="html" label="MapPartitionsRDD [7268]<br>run at <unknown>:0"]; } subgraph cluster16262 { label="Project"; 7269 [labelType="html" label="MapPartitionsRDD [7269]<br>run at <unknown>:0"]; } subgraph cluster16258 { label="WholeStageCodegen (1)"; 7270 [labelType="html" label="MapPartitionsRDD [7270]<br>run at <unknown>:0"]; } subgraph cluster16272 { label="WholeStageCodegen (1)"; 7272 [labelType="html" label="MapPartitionsRDD [7272]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16271 { label="Filter"; 7273 [labelType="html" label="MapPartitionsRDD [7273]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16270 { label="Project"; 7274 [labelType="html" label="MapPartitionsRDD [7274]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16267 { label="WholeStageCodegen (2)"; 7275 [labelType="html" label="MapPartitionsRDD [7275]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16266 { label="Project"; 7276 [labelType="html" label="MapPartitionsRDD [7276]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16265 { label="DeserializeToObject"; 7277 [labelType="html" label="MapPartitionsRDD [7277]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16264 { label="MapPartitions"; 7278 [labelType="html" label="MapPartitionsRDD [7278]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16274 { label="mapPartitions"; 7280 [labelType="html" label="MapPartitionsRDD [7280]<br>toJavaRDD at <unknown>:0"]; } } 7267->7268; 7268->7269; 7269->7270; 7270->7271; 7271->7272; 7272->7273; 7273->7274; 7274->7275; 7275->7276; 7276->7277; 7277->7278; 7278->7279; 7279->7280; 7280->7281; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time