3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 284 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 418
Associated Job Ids:
284
DAG Visualization
digraph G { subgraph clusterstage_284 { label="Stage 284"; 2986 [labelType="html" label="SQLExecutionRDD [2986]<br>run at <unknown>:0"]; 2994 [labelType="html" label="SQLExecutionRDD [2994]<br>toJavaRDD at <unknown>:0"]; 2996 [labelType="html" label="PythonRDD [2996]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6679 { label="MicroBatchScan"; 2982 [labelType="html" label="DataSourceRDD [2982]<br>run at <unknown>:0"]; 2983 [labelType="html" label="MapPartitionsRDD [2983]<br>run at <unknown>:0"]; } subgraph cluster6678 { label="Project"; 2984 [labelType="html" label="MapPartitionsRDD [2984]<br>run at <unknown>:0"]; } subgraph cluster6674 { label="WholeStageCodegen (1)"; 2985 [labelType="html" label="MapPartitionsRDD [2985]<br>run at <unknown>:0"]; } subgraph cluster6688 { label="WholeStageCodegen (1)"; 2987 [labelType="html" label="MapPartitionsRDD [2987]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6687 { label="Filter"; 2988 [labelType="html" label="MapPartitionsRDD [2988]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6686 { label="Project"; 2989 [labelType="html" label="MapPartitionsRDD [2989]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6683 { label="WholeStageCodegen (2)"; 2990 [labelType="html" label="MapPartitionsRDD [2990]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6682 { label="Project"; 2991 [labelType="html" label="MapPartitionsRDD [2991]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6681 { label="DeserializeToObject"; 2992 [labelType="html" label="MapPartitionsRDD [2992]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6680 { label="MapPartitions"; 2993 [labelType="html" label="MapPartitionsRDD [2993]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6690 { label="mapPartitions"; 2995 [labelType="html" label="MapPartitionsRDD [2995]<br>toJavaRDD at <unknown>:0"]; } } 2982->2983; 2983->2984; 2984->2985; 2985->2986; 2986->2987; 2987->2988; 2988->2989; 2989->2990; 2990->2991; 2991->2992; 2992->2993; 2993->2994; 2994->2995; 2995->2996; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time