3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 193 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 431
Associated Job Ids:
193
DAG Visualization
digraph G { subgraph clusterstage_193 { label="Stage 193"; 2026 [labelType="html" label="SQLExecutionRDD [2026]<br>run at <unknown>:0"]; 2034 [labelType="html" label="SQLExecutionRDD [2034]<br>toJavaRDD at <unknown>:0"]; 2036 [labelType="html" label="PythonRDD [2036]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster4525 { label="MicroBatchScan"; 2022 [labelType="html" label="DataSourceRDD [2022]<br>run at <unknown>:0"]; 2023 [labelType="html" label="MapPartitionsRDD [2023]<br>run at <unknown>:0"]; } subgraph cluster4524 { label="Project"; 2024 [labelType="html" label="MapPartitionsRDD [2024]<br>run at <unknown>:0"]; } subgraph cluster4520 { label="WholeStageCodegen (1)"; 2025 [labelType="html" label="MapPartitionsRDD [2025]<br>run at <unknown>:0"]; } subgraph cluster4534 { label="WholeStageCodegen (1)"; 2027 [labelType="html" label="MapPartitionsRDD [2027]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4533 { label="Filter"; 2028 [labelType="html" label="MapPartitionsRDD [2028]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4532 { label="Project"; 2029 [labelType="html" label="MapPartitionsRDD [2029]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4529 { label="WholeStageCodegen (2)"; 2030 [labelType="html" label="MapPartitionsRDD [2030]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4528 { label="Project"; 2031 [labelType="html" label="MapPartitionsRDD [2031]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4527 { label="DeserializeToObject"; 2032 [labelType="html" label="MapPartitionsRDD [2032]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4526 { label="MapPartitions"; 2033 [labelType="html" label="MapPartitionsRDD [2033]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4536 { label="mapPartitions"; 2035 [labelType="html" label="MapPartitionsRDD [2035]<br>toJavaRDD at <unknown>:0"]; } } 2022->2023; 2023->2024; 2024->2025; 2025->2026; 2026->2027; 2027->2028; 2028->2029; 2029->2030; 2030->2031; 2031->2032; 2032->2033; 2033->2034; 2034->2035; 2035->2036; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time