3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1153 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 461
Associated Job Ids:
1154
DAG Visualization
digraph G { subgraph clusterstage_1153 { label="Stage 1153"; 12122 [labelType="html" label="SQLExecutionRDD [12122]<br>run at <unknown>:0"]; 12130 [labelType="html" label="SQLExecutionRDD [12130]<br>toJavaRDD at <unknown>:0"]; 12132 [labelType="html" label="PythonRDD [12132]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster27120 { label="MicroBatchScan"; 12118 [labelType="html" label="DataSourceRDD [12118]<br>run at <unknown>:0"]; 12119 [labelType="html" label="MapPartitionsRDD [12119]<br>run at <unknown>:0"]; } subgraph cluster27119 { label="Project"; 12120 [labelType="html" label="MapPartitionsRDD [12120]<br>run at <unknown>:0"]; } subgraph cluster27115 { label="WholeStageCodegen (1)"; 12121 [labelType="html" label="MapPartitionsRDD [12121]<br>run at <unknown>:0"]; } subgraph cluster27129 { label="WholeStageCodegen (1)"; 12123 [labelType="html" label="MapPartitionsRDD [12123]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27128 { label="Filter"; 12124 [labelType="html" label="MapPartitionsRDD [12124]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27127 { label="Project"; 12125 [labelType="html" label="MapPartitionsRDD [12125]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27124 { label="WholeStageCodegen (2)"; 12126 [labelType="html" label="MapPartitionsRDD [12126]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27123 { label="Project"; 12127 [labelType="html" label="MapPartitionsRDD [12127]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27122 { label="DeserializeToObject"; 12128 [labelType="html" label="MapPartitionsRDD [12128]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27121 { label="MapPartitions"; 12129 [labelType="html" label="MapPartitionsRDD [12129]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27131 { label="mapPartitions"; 12131 [labelType="html" label="MapPartitionsRDD [12131]<br>toJavaRDD at <unknown>:0"]; } } 12118->12119; 12119->12120; 12120->12121; 12121->12122; 12122->12123; 12123->12124; 12124->12125; 12125->12126; 12126->12127; 12127->12128; 12128->12129; 12129->12130; 12130->12131; 12131->12132; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time