3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1637 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 481
Associated Job Ids:
1638
DAG Visualization
digraph G { subgraph clusterstage_1637 { label="Stage 1637"; 17204 [labelType="html" label="SQLExecutionRDD [17204]<br>run at <unknown>:0"]; 17212 [labelType="html" label="SQLExecutionRDD [17212]<br>toJavaRDD at <unknown>:0"]; 17214 [labelType="html" label="PythonRDD [17214]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster38494 { label="MicroBatchScan"; 17200 [labelType="html" label="DataSourceRDD [17200]<br>run at <unknown>:0"]; 17201 [labelType="html" label="MapPartitionsRDD [17201]<br>run at <unknown>:0"]; } subgraph cluster38493 { label="Project"; 17202 [labelType="html" label="MapPartitionsRDD [17202]<br>run at <unknown>:0"]; } subgraph cluster38489 { label="WholeStageCodegen (1)"; 17203 [labelType="html" label="MapPartitionsRDD [17203]<br>run at <unknown>:0"]; } subgraph cluster38503 { label="WholeStageCodegen (1)"; 17205 [labelType="html" label="MapPartitionsRDD [17205]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38502 { label="Filter"; 17206 [labelType="html" label="MapPartitionsRDD [17206]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38501 { label="Project"; 17207 [labelType="html" label="MapPartitionsRDD [17207]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38498 { label="WholeStageCodegen (2)"; 17208 [labelType="html" label="MapPartitionsRDD [17208]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38497 { label="Project"; 17209 [labelType="html" label="MapPartitionsRDD [17209]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38496 { label="DeserializeToObject"; 17210 [labelType="html" label="MapPartitionsRDD [17210]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38495 { label="MapPartitions"; 17211 [labelType="html" label="MapPartitionsRDD [17211]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38505 { label="mapPartitions"; 17213 [labelType="html" label="MapPartitionsRDD [17213]<br>toJavaRDD at <unknown>:0"]; } } 17200->17201; 17201->17202; 17202->17203; 17203->17204; 17204->17205; 17205->17206; 17206->17207; 17207->17208; 17208->17209; 17209->17210; 17210->17211; 17211->17212; 17212->17213; 17213->17214; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time