3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 688 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 451
Associated Job Ids:
688
DAG Visualization
digraph G { subgraph clusterstage_688 { label="Stage 688"; 7228 [labelType="html" label="SQLExecutionRDD [7228]<br>run at <unknown>:0"]; 7236 [labelType="html" label="SQLExecutionRDD [7236]<br>toJavaRDD at <unknown>:0"]; 7238 [labelType="html" label="PythonRDD [7238]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16173 { label="MicroBatchScan"; 7224 [labelType="html" label="DataSourceRDD [7224]<br>run at <unknown>:0"]; 7225 [labelType="html" label="MapPartitionsRDD [7225]<br>run at <unknown>:0"]; } subgraph cluster16172 { label="Project"; 7226 [labelType="html" label="MapPartitionsRDD [7226]<br>run at <unknown>:0"]; } subgraph cluster16168 { label="WholeStageCodegen (1)"; 7227 [labelType="html" label="MapPartitionsRDD [7227]<br>run at <unknown>:0"]; } subgraph cluster16182 { label="WholeStageCodegen (1)"; 7229 [labelType="html" label="MapPartitionsRDD [7229]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16181 { label="Filter"; 7230 [labelType="html" label="MapPartitionsRDD [7230]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16180 { label="Project"; 7231 [labelType="html" label="MapPartitionsRDD [7231]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16177 { label="WholeStageCodegen (2)"; 7232 [labelType="html" label="MapPartitionsRDD [7232]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16176 { label="Project"; 7233 [labelType="html" label="MapPartitionsRDD [7233]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16175 { label="DeserializeToObject"; 7234 [labelType="html" label="MapPartitionsRDD [7234]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16174 { label="MapPartitions"; 7235 [labelType="html" label="MapPartitionsRDD [7235]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16184 { label="mapPartitions"; 7237 [labelType="html" label="MapPartitionsRDD [7237]<br>toJavaRDD at <unknown>:0"]; } } 7224->7225; 7225->7226; 7226->7227; 7227->7228; 7228->7229; 7229->7230; 7230->7231; 7231->7232; 7232->7233; 7233->7234; 7234->7235; 7235->7236; 7236->7237; 7237->7238; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time