3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1045 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 411
Associated Job Ids:
1046
DAG Visualization
digraph G { subgraph clusterstage_1045 { label="Stage 1045"; 10988 [labelType="html" label="SQLExecutionRDD [10988]<br>run at <unknown>:0"]; 10996 [labelType="html" label="SQLExecutionRDD [10996]<br>toJavaRDD at <unknown>:0"]; 10998 [labelType="html" label="PythonRDD [10998]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster24582 { label="MicroBatchScan"; 10984 [labelType="html" label="DataSourceRDD [10984]<br>run at <unknown>:0"]; 10985 [labelType="html" label="MapPartitionsRDD [10985]<br>run at <unknown>:0"]; } subgraph cluster24581 { label="Project"; 10986 [labelType="html" label="MapPartitionsRDD [10986]<br>run at <unknown>:0"]; } subgraph cluster24577 { label="WholeStageCodegen (1)"; 10987 [labelType="html" label="MapPartitionsRDD [10987]<br>run at <unknown>:0"]; } subgraph cluster24591 { label="WholeStageCodegen (1)"; 10989 [labelType="html" label="MapPartitionsRDD [10989]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24590 { label="Filter"; 10990 [labelType="html" label="MapPartitionsRDD [10990]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24589 { label="Project"; 10991 [labelType="html" label="MapPartitionsRDD [10991]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24586 { label="WholeStageCodegen (2)"; 10992 [labelType="html" label="MapPartitionsRDD [10992]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24585 { label="Project"; 10993 [labelType="html" label="MapPartitionsRDD [10993]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24584 { label="DeserializeToObject"; 10994 [labelType="html" label="MapPartitionsRDD [10994]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24583 { label="MapPartitions"; 10995 [labelType="html" label="MapPartitionsRDD [10995]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster24593 { label="mapPartitions"; 10997 [labelType="html" label="MapPartitionsRDD [10997]<br>toJavaRDD at <unknown>:0"]; } } 10984->10985; 10985->10986; 10986->10987; 10987->10988; 10988->10989; 10989->10990; 10990->10991; 10991->10992; 10992->10993; 10993->10994; 10994->10995; 10995->10996; 10996->10997; 10997->10998; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time