3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2033 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 536
Associated Job Ids:
2034
DAG Visualization
digraph G { subgraph clusterstage_2033 { label="Stage 2033"; 21362 [labelType="html" label="SQLExecutionRDD [21362]<br>run at <unknown>:0"]; 21370 [labelType="html" label="SQLExecutionRDD [21370]<br>toJavaRDD at <unknown>:0"]; 21372 [labelType="html" label="PythonRDD [21372]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47800 { label="MicroBatchScan"; 21358 [labelType="html" label="DataSourceRDD [21358]<br>run at <unknown>:0"]; 21359 [labelType="html" label="MapPartitionsRDD [21359]<br>run at <unknown>:0"]; } subgraph cluster47799 { label="Project"; 21360 [labelType="html" label="MapPartitionsRDD [21360]<br>run at <unknown>:0"]; } subgraph cluster47795 { label="WholeStageCodegen (1)"; 21361 [labelType="html" label="MapPartitionsRDD [21361]<br>run at <unknown>:0"]; } subgraph cluster47809 { label="WholeStageCodegen (1)"; 21363 [labelType="html" label="MapPartitionsRDD [21363]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47808 { label="Filter"; 21364 [labelType="html" label="MapPartitionsRDD [21364]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47807 { label="Project"; 21365 [labelType="html" label="MapPartitionsRDD [21365]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47804 { label="WholeStageCodegen (2)"; 21366 [labelType="html" label="MapPartitionsRDD [21366]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47803 { label="Project"; 21367 [labelType="html" label="MapPartitionsRDD [21367]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47802 { label="DeserializeToObject"; 21368 [labelType="html" label="MapPartitionsRDD [21368]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47801 { label="MapPartitions"; 21369 [labelType="html" label="MapPartitionsRDD [21369]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47811 { label="mapPartitions"; 21371 [labelType="html" label="MapPartitionsRDD [21371]<br>toJavaRDD at <unknown>:0"]; } } 21358->21359; 21359->21360; 21360->21361; 21361->21362; 21362->21363; 21363->21364; 21364->21365; 21365->21366; 21366->21367; 21367->21368; 21368->21369; 21369->21370; 21370->21371; 21371->21372; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time