3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1862 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 395
Associated Job Ids:
1862
DAG Visualization
digraph G { subgraph clusterstage_1862 { label="Stage 1862"; 19555 [labelType="html" label="SQLExecutionRDD [19555]<br>run at <unknown>:0"]; 19563 [labelType="html" label="SQLExecutionRDD [19563]<br>toJavaRDD at <unknown>:0"]; 19565 [labelType="html" label="PythonRDD [19565]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster43762 { label="MicroBatchScan"; 19551 [labelType="html" label="DataSourceRDD [19551]<br>run at <unknown>:0"]; 19552 [labelType="html" label="MapPartitionsRDD [19552]<br>run at <unknown>:0"]; } subgraph cluster43761 { label="Project"; 19553 [labelType="html" label="MapPartitionsRDD [19553]<br>run at <unknown>:0"]; } subgraph cluster43757 { label="WholeStageCodegen (1)"; 19554 [labelType="html" label="MapPartitionsRDD [19554]<br>run at <unknown>:0"]; } subgraph cluster43771 { label="WholeStageCodegen (1)"; 19556 [labelType="html" label="MapPartitionsRDD [19556]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43770 { label="Filter"; 19557 [labelType="html" label="MapPartitionsRDD [19557]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43769 { label="Project"; 19558 [labelType="html" label="MapPartitionsRDD [19558]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43766 { label="WholeStageCodegen (2)"; 19559 [labelType="html" label="MapPartitionsRDD [19559]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43765 { label="Project"; 19560 [labelType="html" label="MapPartitionsRDD [19560]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43764 { label="DeserializeToObject"; 19561 [labelType="html" label="MapPartitionsRDD [19561]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43763 { label="MapPartitions"; 19562 [labelType="html" label="MapPartitionsRDD [19562]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43773 { label="mapPartitions"; 19564 [labelType="html" label="MapPartitionsRDD [19564]<br>toJavaRDD at <unknown>:0"]; } } 19551->19552; 19552->19553; 19553->19554; 19554->19555; 19555->19556; 19556->19557; 19557->19558; 19558->19559; 19559->19560; 19560->19561; 19561->19562; 19562->19563; 19563->19564; 19564->19565; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time