3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 647 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 416
Associated Job Ids:
648
DAG Visualization
digraph G { subgraph clusterstage_647 { label="Stage 647"; 6809 [labelType="html" label="SQLExecutionRDD [6809]<br>run at <unknown>:0"]; 6817 [labelType="html" label="SQLExecutionRDD [6817]<br>toJavaRDD at <unknown>:0"]; 6819 [labelType="html" label="PythonRDD [6819]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster15229 { label="MicroBatchScan"; 6805 [labelType="html" label="DataSourceRDD [6805]<br>run at <unknown>:0"]; 6806 [labelType="html" label="MapPartitionsRDD [6806]<br>run at <unknown>:0"]; } subgraph cluster15228 { label="Project"; 6807 [labelType="html" label="MapPartitionsRDD [6807]<br>run at <unknown>:0"]; } subgraph cluster15224 { label="WholeStageCodegen (1)"; 6808 [labelType="html" label="MapPartitionsRDD [6808]<br>run at <unknown>:0"]; } subgraph cluster15238 { label="WholeStageCodegen (1)"; 6810 [labelType="html" label="MapPartitionsRDD [6810]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15237 { label="Filter"; 6811 [labelType="html" label="MapPartitionsRDD [6811]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15236 { label="Project"; 6812 [labelType="html" label="MapPartitionsRDD [6812]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15233 { label="WholeStageCodegen (2)"; 6813 [labelType="html" label="MapPartitionsRDD [6813]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15232 { label="Project"; 6814 [labelType="html" label="MapPartitionsRDD [6814]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15231 { label="DeserializeToObject"; 6815 [labelType="html" label="MapPartitionsRDD [6815]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15230 { label="MapPartitions"; 6816 [labelType="html" label="MapPartitionsRDD [6816]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15240 { label="mapPartitions"; 6818 [labelType="html" label="MapPartitionsRDD [6818]<br>toJavaRDD at <unknown>:0"]; } } 6805->6806; 6806->6807; 6807->6808; 6808->6809; 6809->6810; 6810->6811; 6811->6812; 6812->6813; 6813->6814; 6814->6815; 6815->6816; 6816->6817; 6817->6818; 6818->6819; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time