3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1403 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 512
Associated Job Ids:
1404
DAG Visualization
digraph G { subgraph clusterstage_1403 { label="Stage 1403"; 14747 [labelType="html" label="SQLExecutionRDD [14747]<br>run at <unknown>:0"]; 14755 [labelType="html" label="SQLExecutionRDD [14755]<br>toJavaRDD at <unknown>:0"]; 14757 [labelType="html" label="PythonRDD [14757]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster32995 { label="MicroBatchScan"; 14743 [labelType="html" label="DataSourceRDD [14743]<br>run at <unknown>:0"]; 14744 [labelType="html" label="MapPartitionsRDD [14744]<br>run at <unknown>:0"]; } subgraph cluster32994 { label="Project"; 14745 [labelType="html" label="MapPartitionsRDD [14745]<br>run at <unknown>:0"]; } subgraph cluster32990 { label="WholeStageCodegen (1)"; 14746 [labelType="html" label="MapPartitionsRDD [14746]<br>run at <unknown>:0"]; } subgraph cluster33004 { label="WholeStageCodegen (1)"; 14748 [labelType="html" label="MapPartitionsRDD [14748]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33003 { label="Filter"; 14749 [labelType="html" label="MapPartitionsRDD [14749]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33002 { label="Project"; 14750 [labelType="html" label="MapPartitionsRDD [14750]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32999 { label="WholeStageCodegen (2)"; 14751 [labelType="html" label="MapPartitionsRDD [14751]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32998 { label="Project"; 14752 [labelType="html" label="MapPartitionsRDD [14752]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32997 { label="DeserializeToObject"; 14753 [labelType="html" label="MapPartitionsRDD [14753]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32996 { label="MapPartitions"; 14754 [labelType="html" label="MapPartitionsRDD [14754]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33006 { label="mapPartitions"; 14756 [labelType="html" label="MapPartitionsRDD [14756]<br>toJavaRDD at <unknown>:0"]; } } 14743->14744; 14744->14745; 14745->14746; 14746->14747; 14747->14748; 14748->14749; 14749->14750; 14750->14751; 14751->14752; 14752->14753; 14753->14754; 14754->14755; 14755->14756; 14756->14757; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time