3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1150 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 567
Associated Job Ids:
1151
DAG Visualization
digraph G { subgraph clusterstage_1150 { label="Stage 1150"; 12086 [labelType="html" label="SQLExecutionRDD [12086]<br>run at <unknown>:0"]; 12094 [labelType="html" label="SQLExecutionRDD [12094]<br>toJavaRDD at <unknown>:0"]; 12096 [labelType="html" label="PythonRDD [12096]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster27034 { label="MicroBatchScan"; 12082 [labelType="html" label="DataSourceRDD [12082]<br>run at <unknown>:0"]; 12083 [labelType="html" label="MapPartitionsRDD [12083]<br>run at <unknown>:0"]; } subgraph cluster27033 { label="Project"; 12084 [labelType="html" label="MapPartitionsRDD [12084]<br>run at <unknown>:0"]; } subgraph cluster27029 { label="WholeStageCodegen (1)"; 12085 [labelType="html" label="MapPartitionsRDD [12085]<br>run at <unknown>:0"]; } subgraph cluster27043 { label="WholeStageCodegen (1)"; 12087 [labelType="html" label="MapPartitionsRDD [12087]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27042 { label="Filter"; 12088 [labelType="html" label="MapPartitionsRDD [12088]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27041 { label="Project"; 12089 [labelType="html" label="MapPartitionsRDD [12089]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27038 { label="WholeStageCodegen (2)"; 12090 [labelType="html" label="MapPartitionsRDD [12090]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27037 { label="Project"; 12091 [labelType="html" label="MapPartitionsRDD [12091]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27036 { label="DeserializeToObject"; 12092 [labelType="html" label="MapPartitionsRDD [12092]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27035 { label="MapPartitions"; 12093 [labelType="html" label="MapPartitionsRDD [12093]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27045 { label="mapPartitions"; 12095 [labelType="html" label="MapPartitionsRDD [12095]<br>toJavaRDD at <unknown>:0"]; } } 12082->12083; 12083->12084; 12084->12085; 12085->12086; 12086->12087; 12087->12088; 12088->12089; 12089->12090; 12090->12091; 12091->12092; 12092->12093; 12093->12094; 12094->12095; 12095->12096; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time