3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 597 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 367
Associated Job Ids:
598
DAG Visualization
digraph G { subgraph clusterstage_597 { label="Stage 597"; 6284 [labelType="html" label="SQLExecutionRDD [6284]<br>run at <unknown>:0"]; 6292 [labelType="html" label="SQLExecutionRDD [6292]<br>toJavaRDD at <unknown>:0"]; 6294 [labelType="html" label="PythonRDD [6294]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14054 { label="MicroBatchScan"; 6280 [labelType="html" label="DataSourceRDD [6280]<br>run at <unknown>:0"]; 6281 [labelType="html" label="MapPartitionsRDD [6281]<br>run at <unknown>:0"]; } subgraph cluster14053 { label="Project"; 6282 [labelType="html" label="MapPartitionsRDD [6282]<br>run at <unknown>:0"]; } subgraph cluster14049 { label="WholeStageCodegen (1)"; 6283 [labelType="html" label="MapPartitionsRDD [6283]<br>run at <unknown>:0"]; } subgraph cluster14063 { label="WholeStageCodegen (1)"; 6285 [labelType="html" label="MapPartitionsRDD [6285]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14062 { label="Filter"; 6286 [labelType="html" label="MapPartitionsRDD [6286]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14061 { label="Project"; 6287 [labelType="html" label="MapPartitionsRDD [6287]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14058 { label="WholeStageCodegen (2)"; 6288 [labelType="html" label="MapPartitionsRDD [6288]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14057 { label="Project"; 6289 [labelType="html" label="MapPartitionsRDD [6289]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14056 { label="DeserializeToObject"; 6290 [labelType="html" label="MapPartitionsRDD [6290]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14055 { label="MapPartitions"; 6291 [labelType="html" label="MapPartitionsRDD [6291]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14065 { label="mapPartitions"; 6293 [labelType="html" label="MapPartitionsRDD [6293]<br>toJavaRDD at <unknown>:0"]; } } 6280->6281; 6281->6282; 6282->6283; 6283->6284; 6284->6285; 6285->6286; 6286->6287; 6287->6288; 6288->6289; 6289->6290; 6290->6291; 6291->6292; 6292->6293; 6293->6294; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time