3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1237 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 502
Associated Job Ids:
1238
DAG Visualization
digraph G { subgraph clusterstage_1237 { label="Stage 1237"; 13004 [labelType="html" label="SQLExecutionRDD [13004]<br>run at <unknown>:0"]; 13012 [labelType="html" label="SQLExecutionRDD [13012]<br>toJavaRDD at <unknown>:0"]; 13014 [labelType="html" label="PythonRDD [13014]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster29094 { label="MicroBatchScan"; 13000 [labelType="html" label="DataSourceRDD [13000]<br>run at <unknown>:0"]; 13001 [labelType="html" label="MapPartitionsRDD [13001]<br>run at <unknown>:0"]; } subgraph cluster29093 { label="Project"; 13002 [labelType="html" label="MapPartitionsRDD [13002]<br>run at <unknown>:0"]; } subgraph cluster29089 { label="WholeStageCodegen (1)"; 13003 [labelType="html" label="MapPartitionsRDD [13003]<br>run at <unknown>:0"]; } subgraph cluster29103 { label="WholeStageCodegen (1)"; 13005 [labelType="html" label="MapPartitionsRDD [13005]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29102 { label="Filter"; 13006 [labelType="html" label="MapPartitionsRDD [13006]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29101 { label="Project"; 13007 [labelType="html" label="MapPartitionsRDD [13007]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29098 { label="WholeStageCodegen (2)"; 13008 [labelType="html" label="MapPartitionsRDD [13008]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29097 { label="Project"; 13009 [labelType="html" label="MapPartitionsRDD [13009]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29096 { label="DeserializeToObject"; 13010 [labelType="html" label="MapPartitionsRDD [13010]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29095 { label="MapPartitions"; 13011 [labelType="html" label="MapPartitionsRDD [13011]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster29105 { label="mapPartitions"; 13013 [labelType="html" label="MapPartitionsRDD [13013]<br>toJavaRDD at <unknown>:0"]; } } 13000->13001; 13001->13002; 13002->13003; 13003->13004; 13004->13005; 13005->13006; 13006->13007; 13007->13008; 13008->13009; 13009->13010; 13010->13011; 13011->13012; 13012->13013; 13013->13014; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time