3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1196 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 359
Associated Job Ids:
1197
DAG Visualization
digraph G { subgraph clusterstage_1196 { label="Stage 1196"; 12563 [labelType="html" label="SQLExecutionRDD [12563]<br>run at <unknown>:0"]; 12577 [labelType="html" label="SQLExecutionRDD [12577]<br>toJavaRDD at <unknown>:0"]; 12579 [labelType="html" label="PythonRDD [12579]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster28107 { label="MicroBatchScan"; 12559 [labelType="html" label="DataSourceRDD [12559]<br>run at <unknown>:0"]; 12560 [labelType="html" label="MapPartitionsRDD [12560]<br>run at <unknown>:0"]; } subgraph cluster28106 { label="Project"; 12561 [labelType="html" label="MapPartitionsRDD [12561]<br>run at <unknown>:0"]; } subgraph cluster28102 { label="WholeStageCodegen (1)"; 12562 [labelType="html" label="MapPartitionsRDD [12562]<br>run at <unknown>:0"]; } subgraph cluster28124 { label="WholeStageCodegen (1)"; 12570 [labelType="html" label="MapPartitionsRDD [12570]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28123 { label="Filter"; 12571 [labelType="html" label="MapPartitionsRDD [12571]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28122 { label="Project"; 12572 [labelType="html" label="MapPartitionsRDD [12572]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28119 { label="WholeStageCodegen (2)"; 12573 [labelType="html" label="MapPartitionsRDD [12573]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28118 { label="Project"; 12574 [labelType="html" label="MapPartitionsRDD [12574]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28117 { label="DeserializeToObject"; 12575 [labelType="html" label="MapPartitionsRDD [12575]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28116 { label="MapPartitions"; 12576 [labelType="html" label="MapPartitionsRDD [12576]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28126 { label="mapPartitions"; 12578 [labelType="html" label="MapPartitionsRDD [12578]<br>toJavaRDD at <unknown>:0"]; } } 12559->12560; 12560->12561; 12561->12562; 12562->12563; 12563->12570; 12570->12571; 12571->12572; 12572->12573; 12573->12574; 12574->12575; 12575->12576; 12576->12577; 12577->12578; 12578->12579; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time