3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1623 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 423
Associated Job Ids:
1624
DAG Visualization
digraph G { subgraph clusterstage_1623 { label="Stage 1623"; 17057 [labelType="html" label="SQLExecutionRDD [17057]<br>run at <unknown>:0"]; 17065 [labelType="html" label="SQLExecutionRDD [17065]<br>toJavaRDD at <unknown>:0"]; 17067 [labelType="html" label="PythonRDD [17067]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster38165 { label="MicroBatchScan"; 17053 [labelType="html" label="DataSourceRDD [17053]<br>run at <unknown>:0"]; 17054 [labelType="html" label="MapPartitionsRDD [17054]<br>run at <unknown>:0"]; } subgraph cluster38164 { label="Project"; 17055 [labelType="html" label="MapPartitionsRDD [17055]<br>run at <unknown>:0"]; } subgraph cluster38160 { label="WholeStageCodegen (1)"; 17056 [labelType="html" label="MapPartitionsRDD [17056]<br>run at <unknown>:0"]; } subgraph cluster38174 { label="WholeStageCodegen (1)"; 17058 [labelType="html" label="MapPartitionsRDD [17058]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38173 { label="Filter"; 17059 [labelType="html" label="MapPartitionsRDD [17059]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38172 { label="Project"; 17060 [labelType="html" label="MapPartitionsRDD [17060]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38169 { label="WholeStageCodegen (2)"; 17061 [labelType="html" label="MapPartitionsRDD [17061]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38168 { label="Project"; 17062 [labelType="html" label="MapPartitionsRDD [17062]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38167 { label="DeserializeToObject"; 17063 [labelType="html" label="MapPartitionsRDD [17063]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38166 { label="MapPartitions"; 17064 [labelType="html" label="MapPartitionsRDD [17064]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38176 { label="mapPartitions"; 17066 [labelType="html" label="MapPartitionsRDD [17066]<br>toJavaRDD at <unknown>:0"]; } } 17053->17054; 17054->17055; 17055->17056; 17056->17057; 17057->17058; 17058->17059; 17059->17060; 17060->17061; 17061->17062; 17062->17063; 17063->17064; 17064->17065; 17065->17066; 17066->17067; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time