3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 686 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 482
Associated Job Ids:
686
DAG Visualization
digraph G { subgraph clusterstage_686 { label="Stage 686"; 7207 [labelType="html" label="SQLExecutionRDD [7207]<br>run at <unknown>:0"]; 7215 [labelType="html" label="SQLExecutionRDD [7215]<br>toJavaRDD at <unknown>:0"]; 7223 [labelType="html" label="PythonRDD [7223]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16126 { label="MicroBatchScan"; 7203 [labelType="html" label="DataSourceRDD [7203]<br>run at <unknown>:0"]; 7204 [labelType="html" label="MapPartitionsRDD [7204]<br>run at <unknown>:0"]; } subgraph cluster16125 { label="Project"; 7205 [labelType="html" label="MapPartitionsRDD [7205]<br>run at <unknown>:0"]; } subgraph cluster16121 { label="WholeStageCodegen (1)"; 7206 [labelType="html" label="MapPartitionsRDD [7206]<br>run at <unknown>:0"]; } subgraph cluster16135 { label="WholeStageCodegen (1)"; 7208 [labelType="html" label="MapPartitionsRDD [7208]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16134 { label="Filter"; 7209 [labelType="html" label="MapPartitionsRDD [7209]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16133 { label="Project"; 7210 [labelType="html" label="MapPartitionsRDD [7210]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16130 { label="WholeStageCodegen (2)"; 7211 [labelType="html" label="MapPartitionsRDD [7211]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16129 { label="Project"; 7212 [labelType="html" label="MapPartitionsRDD [7212]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16128 { label="DeserializeToObject"; 7213 [labelType="html" label="MapPartitionsRDD [7213]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16127 { label="MapPartitions"; 7214 [labelType="html" label="MapPartitionsRDD [7214]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16137 { label="mapPartitions"; 7216 [labelType="html" label="MapPartitionsRDD [7216]<br>toJavaRDD at <unknown>:0"]; } } 7203->7204; 7204->7205; 7205->7206; 7206->7207; 7207->7208; 7208->7209; 7209->7210; 7210->7211; 7211->7212; 7212->7213; 7213->7214; 7214->7215; 7215->7216; 7216->7223; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time