3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 486 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 492
Associated Job Ids:
486
DAG Visualization
digraph G { subgraph clusterstage_486 { label="Stage 486"; 5107 [labelType="html" label="SQLExecutionRDD [5107]<br>run at <unknown>:0"]; 5115 [labelType="html" label="SQLExecutionRDD [5115]<br>toJavaRDD at <unknown>:0"]; 5117 [labelType="html" label="PythonRDD [5117]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11426 { label="MicroBatchScan"; 5103 [labelType="html" label="DataSourceRDD [5103]<br>run at <unknown>:0"]; 5104 [labelType="html" label="MapPartitionsRDD [5104]<br>run at <unknown>:0"]; } subgraph cluster11425 { label="Project"; 5105 [labelType="html" label="MapPartitionsRDD [5105]<br>run at <unknown>:0"]; } subgraph cluster11421 { label="WholeStageCodegen (1)"; 5106 [labelType="html" label="MapPartitionsRDD [5106]<br>run at <unknown>:0"]; } subgraph cluster11435 { label="WholeStageCodegen (1)"; 5108 [labelType="html" label="MapPartitionsRDD [5108]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11434 { label="Filter"; 5109 [labelType="html" label="MapPartitionsRDD [5109]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11433 { label="Project"; 5110 [labelType="html" label="MapPartitionsRDD [5110]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11430 { label="WholeStageCodegen (2)"; 5111 [labelType="html" label="MapPartitionsRDD [5111]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11429 { label="Project"; 5112 [labelType="html" label="MapPartitionsRDD [5112]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11428 { label="DeserializeToObject"; 5113 [labelType="html" label="MapPartitionsRDD [5113]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11427 { label="MapPartitions"; 5114 [labelType="html" label="MapPartitionsRDD [5114]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11437 { label="mapPartitions"; 5116 [labelType="html" label="MapPartitionsRDD [5116]<br>toJavaRDD at <unknown>:0"]; } } 5103->5104; 5104->5105; 5105->5106; 5106->5107; 5107->5108; 5108->5109; 5109->5110; 5110->5111; 5111->5112; 5112->5113; 5113->5114; 5114->5115; 5115->5116; 5116->5117; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time