3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 497 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 404
Associated Job Ids:
497
DAG Visualization
digraph G { subgraph clusterstage_497 { label="Stage 497"; 5212 [labelType="html" label="SQLExecutionRDD [5212]<br>run at <unknown>:0"]; 5226 [labelType="html" label="SQLExecutionRDD [5226]<br>toJavaRDD at <unknown>:0"]; 5228 [labelType="html" label="PythonRDD [5228]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11661 { label="MicroBatchScan"; 5208 [labelType="html" label="DataSourceRDD [5208]<br>run at <unknown>:0"]; 5209 [labelType="html" label="MapPartitionsRDD [5209]<br>run at <unknown>:0"]; } subgraph cluster11660 { label="Project"; 5210 [labelType="html" label="MapPartitionsRDD [5210]<br>run at <unknown>:0"]; } subgraph cluster11656 { label="WholeStageCodegen (1)"; 5211 [labelType="html" label="MapPartitionsRDD [5211]<br>run at <unknown>:0"]; } subgraph cluster11678 { label="WholeStageCodegen (1)"; 5219 [labelType="html" label="MapPartitionsRDD [5219]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11677 { label="Filter"; 5220 [labelType="html" label="MapPartitionsRDD [5220]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11676 { label="Project"; 5221 [labelType="html" label="MapPartitionsRDD [5221]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11673 { label="WholeStageCodegen (2)"; 5222 [labelType="html" label="MapPartitionsRDD [5222]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11672 { label="Project"; 5223 [labelType="html" label="MapPartitionsRDD [5223]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11671 { label="DeserializeToObject"; 5224 [labelType="html" label="MapPartitionsRDD [5224]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11670 { label="MapPartitions"; 5225 [labelType="html" label="MapPartitionsRDD [5225]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11680 { label="mapPartitions"; 5227 [labelType="html" label="MapPartitionsRDD [5227]<br>toJavaRDD at <unknown>:0"]; } } 5208->5209; 5209->5210; 5210->5211; 5211->5212; 5212->5219; 5219->5220; 5220->5221; 5221->5222; 5222->5223; 5223->5224; 5224->5225; 5225->5226; 5226->5227; 5227->5228; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time