3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 693 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 512
Associated Job Ids:
694
DAG Visualization
digraph G { subgraph clusterstage_693 { label="Stage 693"; 7292 [labelType="html" label="SQLExecutionRDD [7292]<br>run at <unknown>:0"]; 7300 [labelType="html" label="SQLExecutionRDD [7300]<br>toJavaRDD at <unknown>:0"]; 7302 [labelType="html" label="PythonRDD [7302]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16310 { label="MicroBatchScan"; 7288 [labelType="html" label="DataSourceRDD [7288]<br>run at <unknown>:0"]; 7289 [labelType="html" label="MapPartitionsRDD [7289]<br>run at <unknown>:0"]; } subgraph cluster16309 { label="Project"; 7290 [labelType="html" label="MapPartitionsRDD [7290]<br>run at <unknown>:0"]; } subgraph cluster16305 { label="WholeStageCodegen (1)"; 7291 [labelType="html" label="MapPartitionsRDD [7291]<br>run at <unknown>:0"]; } subgraph cluster16319 { label="WholeStageCodegen (1)"; 7293 [labelType="html" label="MapPartitionsRDD [7293]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16318 { label="Filter"; 7294 [labelType="html" label="MapPartitionsRDD [7294]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16317 { label="Project"; 7295 [labelType="html" label="MapPartitionsRDD [7295]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16314 { label="WholeStageCodegen (2)"; 7296 [labelType="html" label="MapPartitionsRDD [7296]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16313 { label="Project"; 7297 [labelType="html" label="MapPartitionsRDD [7297]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16312 { label="DeserializeToObject"; 7298 [labelType="html" label="MapPartitionsRDD [7298]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16311 { label="MapPartitions"; 7299 [labelType="html" label="MapPartitionsRDD [7299]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16321 { label="mapPartitions"; 7301 [labelType="html" label="MapPartitionsRDD [7301]<br>toJavaRDD at <unknown>:0"]; } } 7288->7289; 7289->7290; 7290->7291; 7291->7292; 7292->7293; 7293->7294; 7294->7295; 7295->7296; 7296->7297; 7297->7298; 7298->7299; 7299->7300; 7300->7301; 7301->7302; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time