3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 329 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 487
Associated Job Ids:
329
DAG Visualization
digraph G { subgraph clusterstage_329 { label="Stage 329"; 3448 [labelType="html" label="SQLExecutionRDD [3448]<br>run at <unknown>:0"]; 3462 [labelType="html" label="SQLExecutionRDD [3462]<br>toJavaRDD at <unknown>:0"]; 3464 [labelType="html" label="PythonRDD [3464]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster7713 { label="MicroBatchScan"; 3444 [labelType="html" label="DataSourceRDD [3444]<br>run at <unknown>:0"]; 3445 [labelType="html" label="MapPartitionsRDD [3445]<br>run at <unknown>:0"]; } subgraph cluster7712 { label="Project"; 3446 [labelType="html" label="MapPartitionsRDD [3446]<br>run at <unknown>:0"]; } subgraph cluster7708 { label="WholeStageCodegen (1)"; 3447 [labelType="html" label="MapPartitionsRDD [3447]<br>run at <unknown>:0"]; } subgraph cluster7730 { label="WholeStageCodegen (1)"; 3455 [labelType="html" label="MapPartitionsRDD [3455]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7729 { label="Filter"; 3456 [labelType="html" label="MapPartitionsRDD [3456]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7728 { label="Project"; 3457 [labelType="html" label="MapPartitionsRDD [3457]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7725 { label="WholeStageCodegen (2)"; 3458 [labelType="html" label="MapPartitionsRDD [3458]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7724 { label="Project"; 3459 [labelType="html" label="MapPartitionsRDD [3459]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7723 { label="DeserializeToObject"; 3460 [labelType="html" label="MapPartitionsRDD [3460]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7722 { label="MapPartitions"; 3461 [labelType="html" label="MapPartitionsRDD [3461]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7732 { label="mapPartitions"; 3463 [labelType="html" label="MapPartitionsRDD [3463]<br>toJavaRDD at <unknown>:0"]; } } 3444->3445; 3445->3446; 3446->3447; 3447->3448; 3448->3455; 3455->3456; 3456->3457; 3457->3458; 3458->3459; 3459->3460; 3460->3461; 3461->3462; 3462->3463; 3463->3464; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time