3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 286 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 439
Associated Job Ids:
286
DAG Visualization
digraph G { subgraph clusterstage_286 { label="Stage 286"; 3007 [labelType="html" label="SQLExecutionRDD [3007]<br>run at <unknown>:0"]; 3015 [labelType="html" label="SQLExecutionRDD [3015]<br>toJavaRDD at <unknown>:0"]; 3017 [labelType="html" label="PythonRDD [3017]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6726 { label="MicroBatchScan"; 3003 [labelType="html" label="DataSourceRDD [3003]<br>run at <unknown>:0"]; 3004 [labelType="html" label="MapPartitionsRDD [3004]<br>run at <unknown>:0"]; } subgraph cluster6725 { label="Project"; 3005 [labelType="html" label="MapPartitionsRDD [3005]<br>run at <unknown>:0"]; } subgraph cluster6721 { label="WholeStageCodegen (1)"; 3006 [labelType="html" label="MapPartitionsRDD [3006]<br>run at <unknown>:0"]; } subgraph cluster6735 { label="WholeStageCodegen (1)"; 3008 [labelType="html" label="MapPartitionsRDD [3008]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6734 { label="Filter"; 3009 [labelType="html" label="MapPartitionsRDD [3009]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6733 { label="Project"; 3010 [labelType="html" label="MapPartitionsRDD [3010]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6730 { label="WholeStageCodegen (2)"; 3011 [labelType="html" label="MapPartitionsRDD [3011]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6729 { label="Project"; 3012 [labelType="html" label="MapPartitionsRDD [3012]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6728 { label="DeserializeToObject"; 3013 [labelType="html" label="MapPartitionsRDD [3013]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6727 { label="MapPartitions"; 3014 [labelType="html" label="MapPartitionsRDD [3014]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6737 { label="mapPartitions"; 3016 [labelType="html" label="MapPartitionsRDD [3016]<br>toJavaRDD at <unknown>:0"]; } } 3003->3004; 3004->3005; 3005->3006; 3006->3007; 3007->3008; 3008->3009; 3009->3010; 3010->3011; 3011->3012; 3012->3013; 3013->3014; 3014->3015; 3015->3016; 3016->3017; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time