3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1300 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 442
Associated Job Ids:
1300
DAG Visualization
digraph G { subgraph clusterstage_1300 { label="Stage 1300"; 13654 [labelType="html" label="SQLExecutionRDD [13654]<br>run at <unknown>:0"]; 13662 [labelType="html" label="SQLExecutionRDD [13662]<br>toJavaRDD at <unknown>:0"]; 13664 [labelType="html" label="PythonRDD [13664]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30555 { label="MicroBatchScan"; 13650 [labelType="html" label="DataSourceRDD [13650]<br>run at <unknown>:0"]; 13651 [labelType="html" label="MapPartitionsRDD [13651]<br>run at <unknown>:0"]; } subgraph cluster30554 { label="Project"; 13652 [labelType="html" label="MapPartitionsRDD [13652]<br>run at <unknown>:0"]; } subgraph cluster30550 { label="WholeStageCodegen (1)"; 13653 [labelType="html" label="MapPartitionsRDD [13653]<br>run at <unknown>:0"]; } subgraph cluster30564 { label="WholeStageCodegen (1)"; 13655 [labelType="html" label="MapPartitionsRDD [13655]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30563 { label="Filter"; 13656 [labelType="html" label="MapPartitionsRDD [13656]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30562 { label="Project"; 13657 [labelType="html" label="MapPartitionsRDD [13657]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30559 { label="WholeStageCodegen (2)"; 13658 [labelType="html" label="MapPartitionsRDD [13658]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30558 { label="Project"; 13659 [labelType="html" label="MapPartitionsRDD [13659]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30557 { label="DeserializeToObject"; 13660 [labelType="html" label="MapPartitionsRDD [13660]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30556 { label="MapPartitions"; 13661 [labelType="html" label="MapPartitionsRDD [13661]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30566 { label="mapPartitions"; 13663 [labelType="html" label="MapPartitionsRDD [13663]<br>toJavaRDD at <unknown>:0"]; } } 13650->13651; 13651->13652; 13652->13653; 13653->13654; 13654->13655; 13655->13656; 13656->13657; 13657->13658; 13658->13659; 13659->13660; 13660->13661; 13661->13662; 13662->13663; 13663->13664; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time