3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1051 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 477
Associated Job Ids:
1052
DAG Visualization
digraph G { subgraph clusterstage_1051 { label="Stage 1051"; 11051 [labelType="html" label="SQLExecutionRDD [11051]<br>run at <unknown>:0"]; 11059 [labelType="html" label="SQLExecutionRDD [11059]<br>toJavaRDD at <unknown>:0"]; 11061 [labelType="html" label="PythonRDD [11061]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster24723 { label="MicroBatchScan"; 11047 [labelType="html" label="DataSourceRDD [11047]<br>run at <unknown>:0"]; 11048 [labelType="html" label="MapPartitionsRDD [11048]<br>run at <unknown>:0"]; } subgraph cluster24722 { label="Project"; 11049 [labelType="html" label="MapPartitionsRDD [11049]<br>run at <unknown>:0"]; } subgraph cluster24718 { label="WholeStageCodegen (1)"; 11050 [labelType="html" label="MapPartitionsRDD [11050]<br>run at <unknown>:0"]; } subgraph cluster24732 { label="WholeStageCodegen (1)"; 11052 [labelType="html" label="MapPartitionsRDD [11052]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24731 { label="Filter"; 11053 [labelType="html" label="MapPartitionsRDD [11053]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24730 { label="Project"; 11054 [labelType="html" label="MapPartitionsRDD [11054]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24727 { label="WholeStageCodegen (2)"; 11055 [labelType="html" label="MapPartitionsRDD [11055]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24726 { label="Project"; 11056 [labelType="html" label="MapPartitionsRDD [11056]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24725 { label="DeserializeToObject"; 11057 [labelType="html" label="MapPartitionsRDD [11057]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24724 { label="MapPartitions"; 11058 [labelType="html" label="MapPartitionsRDD [11058]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24734 { label="mapPartitions"; 11060 [labelType="html" label="MapPartitionsRDD [11060]<br>toJavaRDD at <unknown>:0"]; } } 11047->11048; 11048->11049; 11049->11050; 11050->11051; 11051->11052; 11052->11053; 11053->11054; 11054->11055; 11055->11056; 11056->11057; 11057->11058; 11058->11059; 11059->11060; 11060->11061; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time