3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 391 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 408
Associated Job Ids:
391
DAG Visualization
digraph G { subgraph clusterstage_391 { label="Stage 391"; 4099 [labelType="html" label="SQLExecutionRDD [4099]<br>run at <unknown>:0"]; 4113 [labelType="html" label="SQLExecutionRDD [4113]<br>toJavaRDD at <unknown>:0"]; 4115 [labelType="html" label="PythonRDD [4115]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9170 { label="MicroBatchScan"; 4095 [labelType="html" label="DataSourceRDD [4095]<br>run at <unknown>:0"]; 4096 [labelType="html" label="MapPartitionsRDD [4096]<br>run at <unknown>:0"]; } subgraph cluster9169 { label="Project"; 4097 [labelType="html" label="MapPartitionsRDD [4097]<br>run at <unknown>:0"]; } subgraph cluster9165 { label="WholeStageCodegen (1)"; 4098 [labelType="html" label="MapPartitionsRDD [4098]<br>run at <unknown>:0"]; } subgraph cluster9187 { label="WholeStageCodegen (1)"; 4106 [labelType="html" label="MapPartitionsRDD [4106]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9186 { label="Filter"; 4107 [labelType="html" label="MapPartitionsRDD [4107]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9185 { label="Project"; 4108 [labelType="html" label="MapPartitionsRDD [4108]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9182 { label="WholeStageCodegen (2)"; 4109 [labelType="html" label="MapPartitionsRDD [4109]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9181 { label="Project"; 4110 [labelType="html" label="MapPartitionsRDD [4110]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9180 { label="DeserializeToObject"; 4111 [labelType="html" label="MapPartitionsRDD [4111]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9179 { label="MapPartitions"; 4112 [labelType="html" label="MapPartitionsRDD [4112]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9189 { label="mapPartitions"; 4114 [labelType="html" label="MapPartitionsRDD [4114]<br>toJavaRDD at <unknown>:0"]; } } 4095->4096; 4096->4097; 4097->4098; 4098->4099; 4099->4106; 4106->4107; 4107->4108; 4108->4109; 4109->4110; 4110->4111; 4111->4112; 4112->4113; 4113->4114; 4114->4115; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time