3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 674 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 437
Associated Job Ids:
675
DAG Visualization
digraph G { subgraph clusterstage_674 { label="Stage 674"; 7088 [labelType="html" label="SQLExecutionRDD [7088]<br>run at <unknown>:0"]; 7096 [labelType="html" label="SQLExecutionRDD [7096]<br>toJavaRDD at <unknown>:0"]; 7098 [labelType="html" label="PythonRDD [7098]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster15848 { label="MicroBatchScan"; 7084 [labelType="html" label="DataSourceRDD [7084]<br>run at <unknown>:0"]; 7085 [labelType="html" label="MapPartitionsRDD [7085]<br>run at <unknown>:0"]; } subgraph cluster15847 { label="Project"; 7086 [labelType="html" label="MapPartitionsRDD [7086]<br>run at <unknown>:0"]; } subgraph cluster15843 { label="WholeStageCodegen (1)"; 7087 [labelType="html" label="MapPartitionsRDD [7087]<br>run at <unknown>:0"]; } subgraph cluster15857 { label="WholeStageCodegen (1)"; 7089 [labelType="html" label="MapPartitionsRDD [7089]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15856 { label="Filter"; 7090 [labelType="html" label="MapPartitionsRDD [7090]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15855 { label="Project"; 7091 [labelType="html" label="MapPartitionsRDD [7091]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15852 { label="WholeStageCodegen (2)"; 7092 [labelType="html" label="MapPartitionsRDD [7092]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15851 { label="Project"; 7093 [labelType="html" label="MapPartitionsRDD [7093]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15850 { label="DeserializeToObject"; 7094 [labelType="html" label="MapPartitionsRDD [7094]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15849 { label="MapPartitions"; 7095 [labelType="html" label="MapPartitionsRDD [7095]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15859 { label="mapPartitions"; 7097 [labelType="html" label="MapPartitionsRDD [7097]<br>toJavaRDD at <unknown>:0"]; } } 7084->7085; 7085->7086; 7086->7087; 7087->7088; 7088->7089; 7089->7090; 7090->7091; 7091->7092; 7092->7093; 7093->7094; 7094->7095; 7095->7096; 7096->7097; 7097->7098; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time