3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1755 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 369
Associated Job Ids:
1755
DAG Visualization
digraph G { subgraph clusterstage_1755 { label="Stage 1755"; 18421 [labelType="html" label="SQLExecutionRDD [18421]<br>run at <unknown>:0"]; 18435 [labelType="html" label="SQLExecutionRDD [18435]<br>toJavaRDD at <unknown>:0"]; 18437 [labelType="html" label="PythonRDD [18437]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster41224 { label="MicroBatchScan"; 18417 [labelType="html" label="DataSourceRDD [18417]<br>run at <unknown>:0"]; 18418 [labelType="html" label="MapPartitionsRDD [18418]<br>run at <unknown>:0"]; } subgraph cluster41223 { label="Project"; 18419 [labelType="html" label="MapPartitionsRDD [18419]<br>run at <unknown>:0"]; } subgraph cluster41219 { label="WholeStageCodegen (1)"; 18420 [labelType="html" label="MapPartitionsRDD [18420]<br>run at <unknown>:0"]; } subgraph cluster41241 { label="WholeStageCodegen (1)"; 18428 [labelType="html" label="MapPartitionsRDD [18428]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41240 { label="Filter"; 18429 [labelType="html" label="MapPartitionsRDD [18429]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41239 { label="Project"; 18430 [labelType="html" label="MapPartitionsRDD [18430]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41236 { label="WholeStageCodegen (2)"; 18431 [labelType="html" label="MapPartitionsRDD [18431]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41235 { label="Project"; 18432 [labelType="html" label="MapPartitionsRDD [18432]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41234 { label="DeserializeToObject"; 18433 [labelType="html" label="MapPartitionsRDD [18433]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41233 { label="MapPartitions"; 18434 [labelType="html" label="MapPartitionsRDD [18434]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41243 { label="mapPartitions"; 18436 [labelType="html" label="MapPartitionsRDD [18436]<br>toJavaRDD at <unknown>:0"]; } } 18417->18418; 18418->18419; 18419->18420; 18420->18421; 18421->18428; 18428->18429; 18429->18430; 18430->18431; 18431->18432; 18432->18433; 18433->18434; 18434->18435; 18435->18436; 18436->18437; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time