3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1853 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 424
Associated Job Ids:
1853
DAG Visualization
digraph G { subgraph clusterstage_1853 { label="Stage 1853"; 19450 [labelType="html" label="SQLExecutionRDD [19450]<br>run at <unknown>:0"]; 19464 [labelType="html" label="SQLExecutionRDD [19464]<br>toJavaRDD at <unknown>:0"]; 19466 [labelType="html" label="PythonRDD [19466]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster43527 { label="MicroBatchScan"; 19446 [labelType="html" label="DataSourceRDD [19446]<br>run at <unknown>:0"]; 19447 [labelType="html" label="MapPartitionsRDD [19447]<br>run at <unknown>:0"]; } subgraph cluster43526 { label="Project"; 19448 [labelType="html" label="MapPartitionsRDD [19448]<br>run at <unknown>:0"]; } subgraph cluster43522 { label="WholeStageCodegen (1)"; 19449 [labelType="html" label="MapPartitionsRDD [19449]<br>run at <unknown>:0"]; } subgraph cluster43544 { label="WholeStageCodegen (1)"; 19457 [labelType="html" label="MapPartitionsRDD [19457]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43543 { label="Filter"; 19458 [labelType="html" label="MapPartitionsRDD [19458]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43542 { label="Project"; 19459 [labelType="html" label="MapPartitionsRDD [19459]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43539 { label="WholeStageCodegen (2)"; 19460 [labelType="html" label="MapPartitionsRDD [19460]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43538 { label="Project"; 19461 [labelType="html" label="MapPartitionsRDD [19461]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43537 { label="DeserializeToObject"; 19462 [labelType="html" label="MapPartitionsRDD [19462]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43536 { label="MapPartitions"; 19463 [labelType="html" label="MapPartitionsRDD [19463]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43546 { label="mapPartitions"; 19465 [labelType="html" label="MapPartitionsRDD [19465]<br>toJavaRDD at <unknown>:0"]; } } 19446->19447; 19447->19448; 19448->19449; 19449->19450; 19450->19457; 19457->19458; 19458->19459; 19459->19460; 19460->19461; 19461->19462; 19462->19463; 19463->19464; 19464->19465; 19465->19466; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time