3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 264 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 382
Associated Job Ids:
264
DAG Visualization
digraph G { subgraph clusterstage_264 { label="Stage 264"; 2776 [labelType="html" label="SQLExecutionRDD [2776]<br>run at <unknown>:0"]; 2784 [labelType="html" label="SQLExecutionRDD [2784]<br>toJavaRDD at <unknown>:0"]; 2786 [labelType="html" label="PythonRDD [2786]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6209 { label="MicroBatchScan"; 2772 [labelType="html" label="DataSourceRDD [2772]<br>run at <unknown>:0"]; 2773 [labelType="html" label="MapPartitionsRDD [2773]<br>run at <unknown>:0"]; } subgraph cluster6208 { label="Project"; 2774 [labelType="html" label="MapPartitionsRDD [2774]<br>run at <unknown>:0"]; } subgraph cluster6204 { label="WholeStageCodegen (1)"; 2775 [labelType="html" label="MapPartitionsRDD [2775]<br>run at <unknown>:0"]; } subgraph cluster6218 { label="WholeStageCodegen (1)"; 2777 [labelType="html" label="MapPartitionsRDD [2777]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6217 { label="Filter"; 2778 [labelType="html" label="MapPartitionsRDD [2778]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6216 { label="Project"; 2779 [labelType="html" label="MapPartitionsRDD [2779]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6213 { label="WholeStageCodegen (2)"; 2780 [labelType="html" label="MapPartitionsRDD [2780]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6212 { label="Project"; 2781 [labelType="html" label="MapPartitionsRDD [2781]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6211 { label="DeserializeToObject"; 2782 [labelType="html" label="MapPartitionsRDD [2782]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6210 { label="MapPartitions"; 2783 [labelType="html" label="MapPartitionsRDD [2783]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6220 { label="mapPartitions"; 2785 [labelType="html" label="MapPartitionsRDD [2785]<br>toJavaRDD at <unknown>:0"]; } } 2772->2773; 2773->2774; 2774->2775; 2775->2776; 2776->2777; 2777->2778; 2778->2779; 2779->2780; 2780->2781; 2781->2782; 2782->2783; 2783->2784; 2784->2785; 2785->2786; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time