3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 971 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 455
Associated Job Ids:
972
DAG Visualization
digraph G { subgraph clusterstage_971 { label="Stage 971"; 10211 [labelType="html" label="SQLExecutionRDD [10211]<br>run at <unknown>:0"]; 10219 [labelType="html" label="SQLExecutionRDD [10219]<br>toJavaRDD at <unknown>:0"]; 10221 [labelType="html" label="PythonRDD [10221]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster22843 { label="MicroBatchScan"; 10207 [labelType="html" label="DataSourceRDD [10207]<br>run at <unknown>:0"]; 10208 [labelType="html" label="MapPartitionsRDD [10208]<br>run at <unknown>:0"]; } subgraph cluster22842 { label="Project"; 10209 [labelType="html" label="MapPartitionsRDD [10209]<br>run at <unknown>:0"]; } subgraph cluster22838 { label="WholeStageCodegen (1)"; 10210 [labelType="html" label="MapPartitionsRDD [10210]<br>run at <unknown>:0"]; } subgraph cluster22852 { label="WholeStageCodegen (1)"; 10212 [labelType="html" label="MapPartitionsRDD [10212]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22851 { label="Filter"; 10213 [labelType="html" label="MapPartitionsRDD [10213]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22850 { label="Project"; 10214 [labelType="html" label="MapPartitionsRDD [10214]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22847 { label="WholeStageCodegen (2)"; 10215 [labelType="html" label="MapPartitionsRDD [10215]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22846 { label="Project"; 10216 [labelType="html" label="MapPartitionsRDD [10216]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22845 { label="DeserializeToObject"; 10217 [labelType="html" label="MapPartitionsRDD [10217]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22844 { label="MapPartitions"; 10218 [labelType="html" label="MapPartitionsRDD [10218]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22854 { label="mapPartitions"; 10220 [labelType="html" label="MapPartitionsRDD [10220]<br>toJavaRDD at <unknown>:0"]; } } 10207->10208; 10208->10209; 10209->10210; 10210->10211; 10211->10212; 10212->10213; 10213->10214; 10214->10215; 10215->10216; 10216->10217; 10217->10218; 10218->10219; 10219->10220; 10220->10221; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time