3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 19 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 455
Associated Job Ids:
19
DAG Visualization
digraph G { subgraph clusterstage_19 { label="Stage 19"; 193 [labelType="html" label="SQLExecutionRDD [193]<br>run at <unknown>:0"]; 207 [labelType="html" label="SQLExecutionRDD [207]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; 209 [labelType="html" label="PythonRDD [209]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster428 { label="MicroBatchScan"; 189 [labelType="html" label="DataSourceRDD [189]<br>run at <unknown>:0"]; 190 [labelType="html" label="MapPartitionsRDD [190]<br>run at <unknown>:0"]; } subgraph cluster427 { label="Project"; 191 [labelType="html" label="MapPartitionsRDD [191]<br>run at <unknown>:0"]; } subgraph cluster423 { label="WholeStageCodegen (1)"; 192 [labelType="html" label="MapPartitionsRDD [192]<br>run at <unknown>:0"]; } subgraph cluster445 { label="WholeStageCodegen (1)"; 200 [labelType="html" label="MapPartitionsRDD [200]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster444 { label="Filter"; 201 [labelType="html" label="MapPartitionsRDD [201]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster443 { label="Project"; 202 [labelType="html" label="MapPartitionsRDD [202]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster440 { label="WholeStageCodegen (2)"; 203 [labelType="html" label="MapPartitionsRDD [203]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster439 { label="Project"; 204 [labelType="html" label="MapPartitionsRDD [204]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster438 { label="DeserializeToObject"; 205 [labelType="html" label="MapPartitionsRDD [205]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster437 { label="MapPartitions"; 206 [labelType="html" label="MapPartitionsRDD [206]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster447 { label="mapPartitions"; 208 [labelType="html" label="MapPartitionsRDD [208]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } } 189->190; 190->191; 191->192; 192->193; 193->200; 200->201; 201->202; 202->203; 203->204; 204->205; 205->206; 206->207; 207->208; 208->209; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time