3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 484 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 419
Associated Job Ids:
484
DAG Visualization
digraph G { subgraph clusterstage_484 { label="Stage 484"; 5086 [labelType="html" label="SQLExecutionRDD [5086]<br>run at <unknown>:0"]; 5094 [labelType="html" label="SQLExecutionRDD [5094]<br>toJavaRDD at <unknown>:0"]; 5096 [labelType="html" label="PythonRDD [5096]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11379 { label="MicroBatchScan"; 5082 [labelType="html" label="DataSourceRDD [5082]<br>run at <unknown>:0"]; 5083 [labelType="html" label="MapPartitionsRDD [5083]<br>run at <unknown>:0"]; } subgraph cluster11378 { label="Project"; 5084 [labelType="html" label="MapPartitionsRDD [5084]<br>run at <unknown>:0"]; } subgraph cluster11374 { label="WholeStageCodegen (1)"; 5085 [labelType="html" label="MapPartitionsRDD [5085]<br>run at <unknown>:0"]; } subgraph cluster11388 { label="WholeStageCodegen (1)"; 5087 [labelType="html" label="MapPartitionsRDD [5087]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11387 { label="Filter"; 5088 [labelType="html" label="MapPartitionsRDD [5088]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11386 { label="Project"; 5089 [labelType="html" label="MapPartitionsRDD [5089]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11383 { label="WholeStageCodegen (2)"; 5090 [labelType="html" label="MapPartitionsRDD [5090]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11382 { label="Project"; 5091 [labelType="html" label="MapPartitionsRDD [5091]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11381 { label="DeserializeToObject"; 5092 [labelType="html" label="MapPartitionsRDD [5092]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11380 { label="MapPartitions"; 5093 [labelType="html" label="MapPartitionsRDD [5093]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11390 { label="mapPartitions"; 5095 [labelType="html" label="MapPartitionsRDD [5095]<br>toJavaRDD at <unknown>:0"]; } } 5082->5083; 5083->5084; 5084->5085; 5085->5086; 5086->5087; 5087->5088; 5088->5089; 5089->5090; 5090->5091; 5091->5092; 5092->5093; 5093->5094; 5094->5095; 5095->5096; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time