3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 709 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 428
Associated Job Ids:
710
DAG Visualization
digraph G { subgraph clusterstage_709 { label="Stage 709"; 7460 [labelType="html" label="SQLExecutionRDD [7460]<br>run at <unknown>:0"]; 7468 [labelType="html" label="SQLExecutionRDD [7468]<br>toJavaRDD at <unknown>:0"]; 7470 [labelType="html" label="PythonRDD [7470]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16686 { label="MicroBatchScan"; 7456 [labelType="html" label="DataSourceRDD [7456]<br>run at <unknown>:0"]; 7457 [labelType="html" label="MapPartitionsRDD [7457]<br>run at <unknown>:0"]; } subgraph cluster16685 { label="Project"; 7458 [labelType="html" label="MapPartitionsRDD [7458]<br>run at <unknown>:0"]; } subgraph cluster16681 { label="WholeStageCodegen (1)"; 7459 [labelType="html" label="MapPartitionsRDD [7459]<br>run at <unknown>:0"]; } subgraph cluster16695 { label="WholeStageCodegen (1)"; 7461 [labelType="html" label="MapPartitionsRDD [7461]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16694 { label="Filter"; 7462 [labelType="html" label="MapPartitionsRDD [7462]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16693 { label="Project"; 7463 [labelType="html" label="MapPartitionsRDD [7463]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16690 { label="WholeStageCodegen (2)"; 7464 [labelType="html" label="MapPartitionsRDD [7464]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16689 { label="Project"; 7465 [labelType="html" label="MapPartitionsRDD [7465]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16688 { label="DeserializeToObject"; 7466 [labelType="html" label="MapPartitionsRDD [7466]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16687 { label="MapPartitions"; 7467 [labelType="html" label="MapPartitionsRDD [7467]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16697 { label="mapPartitions"; 7469 [labelType="html" label="MapPartitionsRDD [7469]<br>toJavaRDD at <unknown>:0"]; } } 7456->7457; 7457->7458; 7458->7459; 7459->7460; 7460->7461; 7461->7462; 7462->7463; 7463->7464; 7464->7465; 7465->7466; 7466->7467; 7467->7468; 7468->7469; 7469->7470; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time