3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 514 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 388
Associated Job Ids:
514
DAG Visualization
digraph G { subgraph clusterstage_514 { label="Stage 514"; 5401 [labelType="html" label="SQLExecutionRDD [5401]<br>run at <unknown>:0"]; 5409 [labelType="html" label="SQLExecutionRDD [5409]<br>toJavaRDD at <unknown>:0"]; 5411 [labelType="html" label="PythonRDD [5411]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster12084 { label="MicroBatchScan"; 5397 [labelType="html" label="DataSourceRDD [5397]<br>run at <unknown>:0"]; 5398 [labelType="html" label="MapPartitionsRDD [5398]<br>run at <unknown>:0"]; } subgraph cluster12083 { label="Project"; 5399 [labelType="html" label="MapPartitionsRDD [5399]<br>run at <unknown>:0"]; } subgraph cluster12079 { label="WholeStageCodegen (1)"; 5400 [labelType="html" label="MapPartitionsRDD [5400]<br>run at <unknown>:0"]; } subgraph cluster12093 { label="WholeStageCodegen (1)"; 5402 [labelType="html" label="MapPartitionsRDD [5402]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12092 { label="Filter"; 5403 [labelType="html" label="MapPartitionsRDD [5403]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12091 { label="Project"; 5404 [labelType="html" label="MapPartitionsRDD [5404]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12088 { label="WholeStageCodegen (2)"; 5405 [labelType="html" label="MapPartitionsRDD [5405]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12087 { label="Project"; 5406 [labelType="html" label="MapPartitionsRDD [5406]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12086 { label="DeserializeToObject"; 5407 [labelType="html" label="MapPartitionsRDD [5407]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12085 { label="MapPartitions"; 5408 [labelType="html" label="MapPartitionsRDD [5408]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12095 { label="mapPartitions"; 5410 [labelType="html" label="MapPartitionsRDD [5410]<br>toJavaRDD at <unknown>:0"]; } } 5397->5398; 5398->5399; 5399->5400; 5400->5401; 5401->5402; 5402->5403; 5403->5404; 5404->5405; 5405->5406; 5406->5407; 5407->5408; 5408->5409; 5409->5410; 5410->5411; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time