3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 872 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 400
Associated Job Ids:
872
DAG Visualization
digraph G { subgraph clusterstage_872 { label="Stage 872"; 9160 [labelType="html" label="SQLExecutionRDD [9160]<br>run at <unknown>:0"]; 9168 [labelType="html" label="SQLExecutionRDD [9168]<br>toJavaRDD at <unknown>:0"]; 9170 [labelType="html" label="PythonRDD [9170]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20497 { label="MicroBatchScan"; 9156 [labelType="html" label="DataSourceRDD [9156]<br>run at <unknown>:0"]; 9157 [labelType="html" label="MapPartitionsRDD [9157]<br>run at <unknown>:0"]; } subgraph cluster20496 { label="Project"; 9158 [labelType="html" label="MapPartitionsRDD [9158]<br>run at <unknown>:0"]; } subgraph cluster20492 { label="WholeStageCodegen (1)"; 9159 [labelType="html" label="MapPartitionsRDD [9159]<br>run at <unknown>:0"]; } subgraph cluster20506 { label="WholeStageCodegen (1)"; 9161 [labelType="html" label="MapPartitionsRDD [9161]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20505 { label="Filter"; 9162 [labelType="html" label="MapPartitionsRDD [9162]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20504 { label="Project"; 9163 [labelType="html" label="MapPartitionsRDD [9163]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20501 { label="WholeStageCodegen (2)"; 9164 [labelType="html" label="MapPartitionsRDD [9164]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20500 { label="Project"; 9165 [labelType="html" label="MapPartitionsRDD [9165]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20499 { label="DeserializeToObject"; 9166 [labelType="html" label="MapPartitionsRDD [9166]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20498 { label="MapPartitions"; 9167 [labelType="html" label="MapPartitionsRDD [9167]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20508 { label="mapPartitions"; 9169 [labelType="html" label="MapPartitionsRDD [9169]<br>toJavaRDD at <unknown>:0"]; } } 9156->9157; 9157->9158; 9158->9159; 9159->9160; 9160->9161; 9161->9162; 9162->9163; 9163->9164; 9164->9165; 9165->9166; 9166->9167; 9167->9168; 9168->9169; 9169->9170; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time