3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1197 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 426
Associated Job Ids:
1198
DAG Visualization
digraph G { subgraph clusterstage_1197 { label="Stage 1197"; 12584 [labelType="html" label="SQLExecutionRDD [12584]<br>run at <unknown>:0"]; 12592 [labelType="html" label="SQLExecutionRDD [12592]<br>toJavaRDD at <unknown>:0"]; 12594 [labelType="html" label="PythonRDD [12594]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster28154 { label="MicroBatchScan"; 12580 [labelType="html" label="DataSourceRDD [12580]<br>run at <unknown>:0"]; 12581 [labelType="html" label="MapPartitionsRDD [12581]<br>run at <unknown>:0"]; } subgraph cluster28153 { label="Project"; 12582 [labelType="html" label="MapPartitionsRDD [12582]<br>run at <unknown>:0"]; } subgraph cluster28149 { label="WholeStageCodegen (1)"; 12583 [labelType="html" label="MapPartitionsRDD [12583]<br>run at <unknown>:0"]; } subgraph cluster28163 { label="WholeStageCodegen (1)"; 12585 [labelType="html" label="MapPartitionsRDD [12585]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28162 { label="Filter"; 12586 [labelType="html" label="MapPartitionsRDD [12586]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28161 { label="Project"; 12587 [labelType="html" label="MapPartitionsRDD [12587]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28158 { label="WholeStageCodegen (2)"; 12588 [labelType="html" label="MapPartitionsRDD [12588]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28157 { label="Project"; 12589 [labelType="html" label="MapPartitionsRDD [12589]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28156 { label="DeserializeToObject"; 12590 [labelType="html" label="MapPartitionsRDD [12590]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28155 { label="MapPartitions"; 12591 [labelType="html" label="MapPartitionsRDD [12591]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28165 { label="mapPartitions"; 12593 [labelType="html" label="MapPartitionsRDD [12593]<br>toJavaRDD at <unknown>:0"]; } } 12580->12581; 12581->12582; 12582->12583; 12583->12584; 12584->12585; 12585->12586; 12586->12587; 12587->12588; 12588->12589; 12589->12590; 12590->12591; 12591->12592; 12592->12593; 12593->12594; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time