3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 976 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 413
Associated Job Ids:
976
DAG Visualization
digraph G { subgraph clusterstage_976 { label="Stage 976"; 10252 [labelType="html" label="SQLExecutionRDD [10252]<br>run at <unknown>:0"]; 10260 [labelType="html" label="SQLExecutionRDD [10260]<br>toJavaRDD at <unknown>:0"]; 10262 [labelType="html" label="PythonRDD [10262]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster22941 { label="MicroBatchScan"; 10248 [labelType="html" label="DataSourceRDD [10248]<br>run at <unknown>:0"]; 10249 [labelType="html" label="MapPartitionsRDD [10249]<br>run at <unknown>:0"]; } subgraph cluster22940 { label="Project"; 10250 [labelType="html" label="MapPartitionsRDD [10250]<br>run at <unknown>:0"]; } subgraph cluster22936 { label="WholeStageCodegen (1)"; 10251 [labelType="html" label="MapPartitionsRDD [10251]<br>run at <unknown>:0"]; } subgraph cluster22950 { label="WholeStageCodegen (1)"; 10253 [labelType="html" label="MapPartitionsRDD [10253]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22949 { label="Filter"; 10254 [labelType="html" label="MapPartitionsRDD [10254]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22948 { label="Project"; 10255 [labelType="html" label="MapPartitionsRDD [10255]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22945 { label="WholeStageCodegen (2)"; 10256 [labelType="html" label="MapPartitionsRDD [10256]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22944 { label="Project"; 10257 [labelType="html" label="MapPartitionsRDD [10257]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22943 { label="DeserializeToObject"; 10258 [labelType="html" label="MapPartitionsRDD [10258]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22942 { label="MapPartitions"; 10259 [labelType="html" label="MapPartitionsRDD [10259]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22952 { label="mapPartitions"; 10261 [labelType="html" label="MapPartitionsRDD [10261]<br>toJavaRDD at <unknown>:0"]; } } 10248->10249; 10249->10250; 10250->10251; 10251->10252; 10252->10253; 10253->10254; 10254->10255; 10255->10256; 10256->10257; 10257->10258; 10258->10259; 10259->10260; 10260->10261; 10261->10262; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time