3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 684 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 402
Associated Job Ids:
684
DAG Visualization
digraph G { subgraph clusterstage_684 { label="Stage 684"; 7186 [labelType="html" label="SQLExecutionRDD [7186]<br>run at <unknown>:0"]; 7194 [labelType="html" label="SQLExecutionRDD [7194]<br>toJavaRDD at <unknown>:0"]; 7196 [labelType="html" label="PythonRDD [7196]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16079 { label="MicroBatchScan"; 7182 [labelType="html" label="DataSourceRDD [7182]<br>run at <unknown>:0"]; 7183 [labelType="html" label="MapPartitionsRDD [7183]<br>run at <unknown>:0"]; } subgraph cluster16078 { label="Project"; 7184 [labelType="html" label="MapPartitionsRDD [7184]<br>run at <unknown>:0"]; } subgraph cluster16074 { label="WholeStageCodegen (1)"; 7185 [labelType="html" label="MapPartitionsRDD [7185]<br>run at <unknown>:0"]; } subgraph cluster16088 { label="WholeStageCodegen (1)"; 7187 [labelType="html" label="MapPartitionsRDD [7187]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16087 { label="Filter"; 7188 [labelType="html" label="MapPartitionsRDD [7188]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16086 { label="Project"; 7189 [labelType="html" label="MapPartitionsRDD [7189]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16083 { label="WholeStageCodegen (2)"; 7190 [labelType="html" label="MapPartitionsRDD [7190]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16082 { label="Project"; 7191 [labelType="html" label="MapPartitionsRDD [7191]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16081 { label="DeserializeToObject"; 7192 [labelType="html" label="MapPartitionsRDD [7192]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16080 { label="MapPartitions"; 7193 [labelType="html" label="MapPartitionsRDD [7193]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16090 { label="mapPartitions"; 7195 [labelType="html" label="MapPartitionsRDD [7195]<br>toJavaRDD at <unknown>:0"]; } } 7182->7183; 7183->7184; 7184->7185; 7185->7186; 7186->7187; 7187->7188; 7188->7189; 7189->7190; 7190->7191; 7191->7192; 7192->7193; 7193->7194; 7194->7195; 7195->7196; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time