3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 565 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 454
Associated Job Ids:
565
DAG Visualization
digraph G { subgraph clusterstage_565 { label="Stage 565"; 5926 [labelType="html" label="SQLExecutionRDD [5926]<br>run at <unknown>:0"]; 5940 [labelType="html" label="SQLExecutionRDD [5940]<br>toJavaRDD at <unknown>:0"]; 5942 [labelType="html" label="PythonRDD [5942]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster13259 { label="MicroBatchScan"; 5922 [labelType="html" label="DataSourceRDD [5922]<br>run at <unknown>:0"]; 5923 [labelType="html" label="MapPartitionsRDD [5923]<br>run at <unknown>:0"]; } subgraph cluster13258 { label="Project"; 5924 [labelType="html" label="MapPartitionsRDD [5924]<br>run at <unknown>:0"]; } subgraph cluster13254 { label="WholeStageCodegen (1)"; 5925 [labelType="html" label="MapPartitionsRDD [5925]<br>run at <unknown>:0"]; } subgraph cluster13276 { label="WholeStageCodegen (1)"; 5933 [labelType="html" label="MapPartitionsRDD [5933]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13275 { label="Filter"; 5934 [labelType="html" label="MapPartitionsRDD [5934]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13274 { label="Project"; 5935 [labelType="html" label="MapPartitionsRDD [5935]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13271 { label="WholeStageCodegen (2)"; 5936 [labelType="html" label="MapPartitionsRDD [5936]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13270 { label="Project"; 5937 [labelType="html" label="MapPartitionsRDD [5937]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13269 { label="DeserializeToObject"; 5938 [labelType="html" label="MapPartitionsRDD [5938]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13268 { label="MapPartitions"; 5939 [labelType="html" label="MapPartitionsRDD [5939]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13278 { label="mapPartitions"; 5941 [labelType="html" label="MapPartitionsRDD [5941]<br>toJavaRDD at <unknown>:0"]; } } 5922->5923; 5923->5924; 5924->5925; 5925->5926; 5926->5933; 5933->5934; 5934->5935; 5935->5936; 5936->5937; 5937->5938; 5938->5939; 5939->5940; 5940->5941; 5941->5942; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time