3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 465 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 454
Associated Job Ids:
466
DAG Visualization
digraph G { subgraph clusterstage_465 { label="Stage 465"; 4898 [labelType="html" label="SQLExecutionRDD [4898]<br>run at <unknown>:0"]; 4906 [labelType="html" label="SQLExecutionRDD [4906]<br>toJavaRDD at <unknown>:0"]; 4908 [labelType="html" label="PythonRDD [4908]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10952 { label="MicroBatchScan"; 4894 [labelType="html" label="DataSourceRDD [4894]<br>run at <unknown>:0"]; 4895 [labelType="html" label="MapPartitionsRDD [4895]<br>run at <unknown>:0"]; } subgraph cluster10951 { label="Project"; 4896 [labelType="html" label="MapPartitionsRDD [4896]<br>run at <unknown>:0"]; } subgraph cluster10947 { label="WholeStageCodegen (1)"; 4897 [labelType="html" label="MapPartitionsRDD [4897]<br>run at <unknown>:0"]; } subgraph cluster10961 { label="WholeStageCodegen (1)"; 4899 [labelType="html" label="MapPartitionsRDD [4899]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10960 { label="Filter"; 4900 [labelType="html" label="MapPartitionsRDD [4900]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10959 { label="Project"; 4901 [labelType="html" label="MapPartitionsRDD [4901]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10956 { label="WholeStageCodegen (2)"; 4902 [labelType="html" label="MapPartitionsRDD [4902]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10955 { label="Project"; 4903 [labelType="html" label="MapPartitionsRDD [4903]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10954 { label="DeserializeToObject"; 4904 [labelType="html" label="MapPartitionsRDD [4904]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10953 { label="MapPartitions"; 4905 [labelType="html" label="MapPartitionsRDD [4905]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10963 { label="mapPartitions"; 4907 [labelType="html" label="MapPartitionsRDD [4907]<br>toJavaRDD at <unknown>:0"]; } } 4894->4895; 4895->4896; 4896->4897; 4897->4898; 4898->4899; 4899->4900; 4900->4901; 4901->4902; 4902->4903; 4903->4904; 4904->4905; 4905->4906; 4906->4907; 4907->4908; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time