3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 732 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 532
Associated Job Ids:
733
DAG Visualization
digraph G { subgraph clusterstage_732 { label="Stage 732"; 7697 [labelType="html" label="SQLExecutionRDD [7697]<br>run at <unknown>:0"]; 7705 [labelType="html" label="SQLExecutionRDD [7705]<br>toJavaRDD at <unknown>:0"]; 7707 [labelType="html" label="PythonRDD [7707]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster17211 { label="MicroBatchScan"; 7693 [labelType="html" label="DataSourceRDD [7693]<br>run at <unknown>:0"]; 7694 [labelType="html" label="MapPartitionsRDD [7694]<br>run at <unknown>:0"]; } subgraph cluster17210 { label="Project"; 7695 [labelType="html" label="MapPartitionsRDD [7695]<br>run at <unknown>:0"]; } subgraph cluster17206 { label="WholeStageCodegen (1)"; 7696 [labelType="html" label="MapPartitionsRDD [7696]<br>run at <unknown>:0"]; } subgraph cluster17220 { label="WholeStageCodegen (1)"; 7698 [labelType="html" label="MapPartitionsRDD [7698]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17219 { label="Filter"; 7699 [labelType="html" label="MapPartitionsRDD [7699]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17218 { label="Project"; 7700 [labelType="html" label="MapPartitionsRDD [7700]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17215 { label="WholeStageCodegen (2)"; 7701 [labelType="html" label="MapPartitionsRDD [7701]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17214 { label="Project"; 7702 [labelType="html" label="MapPartitionsRDD [7702]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17213 { label="DeserializeToObject"; 7703 [labelType="html" label="MapPartitionsRDD [7703]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17212 { label="MapPartitions"; 7704 [labelType="html" label="MapPartitionsRDD [7704]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17222 { label="mapPartitions"; 7706 [labelType="html" label="MapPartitionsRDD [7706]<br>toJavaRDD at <unknown>:0"]; } } 7693->7694; 7694->7695; 7695->7696; 7696->7697; 7697->7698; 7698->7699; 7699->7700; 7700->7701; 7701->7702; 7702->7703; 7703->7704; 7704->7705; 7705->7706; 7706->7707; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time