3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1494 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 334
Associated Job Ids:
1494
DAG Visualization
digraph G { subgraph clusterstage_1494 { label="Stage 1494"; 15691 [labelType="html" label="SQLExecutionRDD [15691]<br>run at <unknown>:0"]; 15699 [labelType="html" label="SQLExecutionRDD [15699]<br>toJavaRDD at <unknown>:0"]; 15701 [labelType="html" label="PythonRDD [15701]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster35114 { label="MicroBatchScan"; 15687 [labelType="html" label="DataSourceRDD [15687]<br>run at <unknown>:0"]; 15688 [labelType="html" label="MapPartitionsRDD [15688]<br>run at <unknown>:0"]; } subgraph cluster35113 { label="Project"; 15689 [labelType="html" label="MapPartitionsRDD [15689]<br>run at <unknown>:0"]; } subgraph cluster35109 { label="WholeStageCodegen (1)"; 15690 [labelType="html" label="MapPartitionsRDD [15690]<br>run at <unknown>:0"]; } subgraph cluster35123 { label="WholeStageCodegen (1)"; 15692 [labelType="html" label="MapPartitionsRDD [15692]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35122 { label="Filter"; 15693 [labelType="html" label="MapPartitionsRDD [15693]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35121 { label="Project"; 15694 [labelType="html" label="MapPartitionsRDD [15694]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35118 { label="WholeStageCodegen (2)"; 15695 [labelType="html" label="MapPartitionsRDD [15695]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35117 { label="Project"; 15696 [labelType="html" label="MapPartitionsRDD [15696]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35116 { label="DeserializeToObject"; 15697 [labelType="html" label="MapPartitionsRDD [15697]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35115 { label="MapPartitions"; 15698 [labelType="html" label="MapPartitionsRDD [15698]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35125 { label="mapPartitions"; 15700 [labelType="html" label="MapPartitionsRDD [15700]<br>toJavaRDD at <unknown>:0"]; } } 15687->15688; 15688->15689; 15689->15690; 15690->15691; 15691->15692; 15692->15693; 15693->15694; 15694->15695; 15695->15696; 15696->15697; 15697->15698; 15698->15699; 15699->15700; 15700->15701; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time