3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1659 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 344
Associated Job Ids:
1660
DAG Visualization
digraph G { subgraph clusterstage_1659 { label="Stage 1659"; 17435 [labelType="html" label="SQLExecutionRDD [17435]<br>run at <unknown>:0"]; 17443 [labelType="html" label="SQLExecutionRDD [17443]<br>toJavaRDD at <unknown>:0"]; 17445 [labelType="html" label="PythonRDD [17445]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster39011 { label="MicroBatchScan"; 17431 [labelType="html" label="DataSourceRDD [17431]<br>run at <unknown>:0"]; 17432 [labelType="html" label="MapPartitionsRDD [17432]<br>run at <unknown>:0"]; } subgraph cluster39010 { label="Project"; 17433 [labelType="html" label="MapPartitionsRDD [17433]<br>run at <unknown>:0"]; } subgraph cluster39006 { label="WholeStageCodegen (1)"; 17434 [labelType="html" label="MapPartitionsRDD [17434]<br>run at <unknown>:0"]; } subgraph cluster39020 { label="WholeStageCodegen (1)"; 17436 [labelType="html" label="MapPartitionsRDD [17436]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39019 { label="Filter"; 17437 [labelType="html" label="MapPartitionsRDD [17437]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39018 { label="Project"; 17438 [labelType="html" label="MapPartitionsRDD [17438]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39015 { label="WholeStageCodegen (2)"; 17439 [labelType="html" label="MapPartitionsRDD [17439]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39014 { label="Project"; 17440 [labelType="html" label="MapPartitionsRDD [17440]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39013 { label="DeserializeToObject"; 17441 [labelType="html" label="MapPartitionsRDD [17441]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39012 { label="MapPartitions"; 17442 [labelType="html" label="MapPartitionsRDD [17442]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39022 { label="mapPartitions"; 17444 [labelType="html" label="MapPartitionsRDD [17444]<br>toJavaRDD at <unknown>:0"]; } } 17431->17432; 17432->17433; 17433->17434; 17434->17435; 17435->17436; 17436->17437; 17437->17438; 17438->17439; 17439->17440; 17440->17441; 17441->17442; 17442->17443; 17443->17444; 17444->17445; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time