3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 888 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 526
Associated Job Ids:
888
DAG Visualization
digraph G { subgraph clusterstage_888 { label="Stage 888"; 9328 [labelType="html" label="SQLExecutionRDD [9328]<br>run at <unknown>:0"]; 9336 [labelType="html" label="SQLExecutionRDD [9336]<br>toJavaRDD at <unknown>:0"]; 9338 [labelType="html" label="PythonRDD [9338]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20873 { label="MicroBatchScan"; 9324 [labelType="html" label="DataSourceRDD [9324]<br>run at <unknown>:0"]; 9325 [labelType="html" label="MapPartitionsRDD [9325]<br>run at <unknown>:0"]; } subgraph cluster20872 { label="Project"; 9326 [labelType="html" label="MapPartitionsRDD [9326]<br>run at <unknown>:0"]; } subgraph cluster20868 { label="WholeStageCodegen (1)"; 9327 [labelType="html" label="MapPartitionsRDD [9327]<br>run at <unknown>:0"]; } subgraph cluster20882 { label="WholeStageCodegen (1)"; 9329 [labelType="html" label="MapPartitionsRDD [9329]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20881 { label="Filter"; 9330 [labelType="html" label="MapPartitionsRDD [9330]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20880 { label="Project"; 9331 [labelType="html" label="MapPartitionsRDD [9331]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20877 { label="WholeStageCodegen (2)"; 9332 [labelType="html" label="MapPartitionsRDD [9332]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20876 { label="Project"; 9333 [labelType="html" label="MapPartitionsRDD [9333]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20875 { label="DeserializeToObject"; 9334 [labelType="html" label="MapPartitionsRDD [9334]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20874 { label="MapPartitions"; 9335 [labelType="html" label="MapPartitionsRDD [9335]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20884 { label="mapPartitions"; 9337 [labelType="html" label="MapPartitionsRDD [9337]<br>toJavaRDD at <unknown>:0"]; } } 9324->9325; 9325->9326; 9326->9327; 9327->9328; 9328->9329; 9329->9330; 9330->9331; 9331->9332; 9332->9333; 9333->9334; 9334->9335; 9335->9336; 9336->9337; 9337->9338; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time