3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1773 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 412
Associated Job Ids:
1773
DAG Visualization
digraph G { subgraph clusterstage_1773 { label="Stage 1773"; 18610 [labelType="html" label="SQLExecutionRDD [18610]<br>run at <unknown>:0"]; 18624 [labelType="html" label="SQLExecutionRDD [18624]<br>toJavaRDD at <unknown>:0"]; 18626 [labelType="html" label="PythonRDD [18626]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster41647 { label="MicroBatchScan"; 18606 [labelType="html" label="DataSourceRDD [18606]<br>run at <unknown>:0"]; 18607 [labelType="html" label="MapPartitionsRDD [18607]<br>run at <unknown>:0"]; } subgraph cluster41646 { label="Project"; 18608 [labelType="html" label="MapPartitionsRDD [18608]<br>run at <unknown>:0"]; } subgraph cluster41642 { label="WholeStageCodegen (1)"; 18609 [labelType="html" label="MapPartitionsRDD [18609]<br>run at <unknown>:0"]; } subgraph cluster41664 { label="WholeStageCodegen (1)"; 18617 [labelType="html" label="MapPartitionsRDD [18617]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41663 { label="Filter"; 18618 [labelType="html" label="MapPartitionsRDD [18618]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41662 { label="Project"; 18619 [labelType="html" label="MapPartitionsRDD [18619]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41659 { label="WholeStageCodegen (2)"; 18620 [labelType="html" label="MapPartitionsRDD [18620]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41658 { label="Project"; 18621 [labelType="html" label="MapPartitionsRDD [18621]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41657 { label="DeserializeToObject"; 18622 [labelType="html" label="MapPartitionsRDD [18622]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41656 { label="MapPartitions"; 18623 [labelType="html" label="MapPartitionsRDD [18623]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41666 { label="mapPartitions"; 18625 [labelType="html" label="MapPartitionsRDD [18625]<br>toJavaRDD at <unknown>:0"]; } } 18606->18607; 18607->18608; 18608->18609; 18609->18610; 18610->18617; 18617->18618; 18618->18619; 18619->18620; 18620->18621; 18621->18622; 18622->18623; 18623->18624; 18624->18625; 18625->18626; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time