3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1183 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 475
Associated Job Ids:
1184
DAG Visualization
digraph G { subgraph clusterstage_1183 { label="Stage 1183"; 12437 [labelType="html" label="SQLExecutionRDD [12437]<br>run at <unknown>:0"]; 12445 [labelType="html" label="SQLExecutionRDD [12445]<br>toJavaRDD at <unknown>:0"]; 12447 [labelType="html" label="PythonRDD [12447]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster27825 { label="MicroBatchScan"; 12433 [labelType="html" label="DataSourceRDD [12433]<br>run at <unknown>:0"]; 12434 [labelType="html" label="MapPartitionsRDD [12434]<br>run at <unknown>:0"]; } subgraph cluster27824 { label="Project"; 12435 [labelType="html" label="MapPartitionsRDD [12435]<br>run at <unknown>:0"]; } subgraph cluster27820 { label="WholeStageCodegen (1)"; 12436 [labelType="html" label="MapPartitionsRDD [12436]<br>run at <unknown>:0"]; } subgraph cluster27834 { label="WholeStageCodegen (1)"; 12438 [labelType="html" label="MapPartitionsRDD [12438]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27833 { label="Filter"; 12439 [labelType="html" label="MapPartitionsRDD [12439]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27832 { label="Project"; 12440 [labelType="html" label="MapPartitionsRDD [12440]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27829 { label="WholeStageCodegen (2)"; 12441 [labelType="html" label="MapPartitionsRDD [12441]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27828 { label="Project"; 12442 [labelType="html" label="MapPartitionsRDD [12442]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27827 { label="DeserializeToObject"; 12443 [labelType="html" label="MapPartitionsRDD [12443]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27826 { label="MapPartitions"; 12444 [labelType="html" label="MapPartitionsRDD [12444]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27836 { label="mapPartitions"; 12446 [labelType="html" label="MapPartitionsRDD [12446]<br>toJavaRDD at <unknown>:0"]; } } 12433->12434; 12434->12435; 12435->12436; 12436->12437; 12437->12438; 12438->12439; 12439->12440; 12440->12441; 12441->12442; 12442->12443; 12443->12444; 12444->12445; 12445->12446; 12446->12447; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time