3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1369 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 438
Associated Job Ids:
1370
DAG Visualization
digraph G { subgraph clusterstage_1369 { label="Stage 1369"; 14390 [labelType="html" label="SQLExecutionRDD [14390]<br>run at <unknown>:0"]; 14398 [labelType="html" label="SQLExecutionRDD [14398]<br>toJavaRDD at <unknown>:0"]; 14400 [labelType="html" label="PythonRDD [14400]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster32196 { label="MicroBatchScan"; 14386 [labelType="html" label="DataSourceRDD [14386]<br>run at <unknown>:0"]; 14387 [labelType="html" label="MapPartitionsRDD [14387]<br>run at <unknown>:0"]; } subgraph cluster32195 { label="Project"; 14388 [labelType="html" label="MapPartitionsRDD [14388]<br>run at <unknown>:0"]; } subgraph cluster32191 { label="WholeStageCodegen (1)"; 14389 [labelType="html" label="MapPartitionsRDD [14389]<br>run at <unknown>:0"]; } subgraph cluster32205 { label="WholeStageCodegen (1)"; 14391 [labelType="html" label="MapPartitionsRDD [14391]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32204 { label="Filter"; 14392 [labelType="html" label="MapPartitionsRDD [14392]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32203 { label="Project"; 14393 [labelType="html" label="MapPartitionsRDD [14393]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32200 { label="WholeStageCodegen (2)"; 14394 [labelType="html" label="MapPartitionsRDD [14394]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32199 { label="Project"; 14395 [labelType="html" label="MapPartitionsRDD [14395]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32198 { label="DeserializeToObject"; 14396 [labelType="html" label="MapPartitionsRDD [14396]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32197 { label="MapPartitions"; 14397 [labelType="html" label="MapPartitionsRDD [14397]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32207 { label="mapPartitions"; 14399 [labelType="html" label="MapPartitionsRDD [14399]<br>toJavaRDD at <unknown>:0"]; } } 14386->14387; 14387->14388; 14388->14389; 14389->14390; 14390->14391; 14391->14392; 14392->14393; 14393->14394; 14394->14395; 14395->14396; 14396->14397; 14397->14398; 14398->14399; 14399->14400; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time