3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 820 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 351
Associated Job Ids:
820
DAG Visualization
digraph G { subgraph clusterstage_820 { label="Stage 820"; 8614 [labelType="html" label="SQLExecutionRDD [8614]<br>run at <unknown>:0"]; 8622 [labelType="html" label="SQLExecutionRDD [8622]<br>toJavaRDD at <unknown>:0"]; 8624 [labelType="html" label="PythonRDD [8624]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster19275 { label="MicroBatchScan"; 8610 [labelType="html" label="DataSourceRDD [8610]<br>run at <unknown>:0"]; 8611 [labelType="html" label="MapPartitionsRDD [8611]<br>run at <unknown>:0"]; } subgraph cluster19274 { label="Project"; 8612 [labelType="html" label="MapPartitionsRDD [8612]<br>run at <unknown>:0"]; } subgraph cluster19270 { label="WholeStageCodegen (1)"; 8613 [labelType="html" label="MapPartitionsRDD [8613]<br>run at <unknown>:0"]; } subgraph cluster19284 { label="WholeStageCodegen (1)"; 8615 [labelType="html" label="MapPartitionsRDD [8615]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19283 { label="Filter"; 8616 [labelType="html" label="MapPartitionsRDD [8616]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19282 { label="Project"; 8617 [labelType="html" label="MapPartitionsRDD [8617]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19279 { label="WholeStageCodegen (2)"; 8618 [labelType="html" label="MapPartitionsRDD [8618]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19278 { label="Project"; 8619 [labelType="html" label="MapPartitionsRDD [8619]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19277 { label="DeserializeToObject"; 8620 [labelType="html" label="MapPartitionsRDD [8620]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19276 { label="MapPartitions"; 8621 [labelType="html" label="MapPartitionsRDD [8621]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19286 { label="mapPartitions"; 8623 [labelType="html" label="MapPartitionsRDD [8623]<br>toJavaRDD at <unknown>:0"]; } } 8610->8611; 8611->8612; 8612->8613; 8613->8614; 8614->8615; 8615->8616; 8616->8617; 8617->8618; 8618->8619; 8619->8620; 8620->8621; 8621->8622; 8622->8623; 8623->8624; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time