3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 696 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 448
Associated Job Ids:
696
DAG Visualization
digraph G { subgraph clusterstage_696 { label="Stage 696"; 7312 [labelType="html" label="SQLExecutionRDD [7312]<br>run at <unknown>:0"]; 7320 [labelType="html" label="SQLExecutionRDD [7320]<br>toJavaRDD at <unknown>:0"]; 7322 [labelType="html" label="PythonRDD [7322]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16361 { label="MicroBatchScan"; 7308 [labelType="html" label="DataSourceRDD [7308]<br>run at <unknown>:0"]; 7309 [labelType="html" label="MapPartitionsRDD [7309]<br>run at <unknown>:0"]; } subgraph cluster16360 { label="Project"; 7310 [labelType="html" label="MapPartitionsRDD [7310]<br>run at <unknown>:0"]; } subgraph cluster16356 { label="WholeStageCodegen (1)"; 7311 [labelType="html" label="MapPartitionsRDD [7311]<br>run at <unknown>:0"]; } subgraph cluster16370 { label="WholeStageCodegen (1)"; 7313 [labelType="html" label="MapPartitionsRDD [7313]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16369 { label="Filter"; 7314 [labelType="html" label="MapPartitionsRDD [7314]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16368 { label="Project"; 7315 [labelType="html" label="MapPartitionsRDD [7315]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16365 { label="WholeStageCodegen (2)"; 7316 [labelType="html" label="MapPartitionsRDD [7316]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16364 { label="Project"; 7317 [labelType="html" label="MapPartitionsRDD [7317]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16363 { label="DeserializeToObject"; 7318 [labelType="html" label="MapPartitionsRDD [7318]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16362 { label="MapPartitions"; 7319 [labelType="html" label="MapPartitionsRDD [7319]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16372 { label="mapPartitions"; 7321 [labelType="html" label="MapPartitionsRDD [7321]<br>toJavaRDD at <unknown>:0"]; } } 7308->7309; 7309->7310; 7310->7311; 7311->7312; 7312->7313; 7313->7314; 7314->7315; 7315->7316; 7316->7317; 7317->7318; 7318->7319; 7319->7320; 7320->7321; 7321->7322; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time