3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 342 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 395
Associated Job Ids:
342
DAG Visualization
digraph G { subgraph clusterstage_342 { label="Stage 342"; 3595 [labelType="html" label="SQLExecutionRDD [3595]<br>run at <unknown>:0"]; 3603 [labelType="html" label="SQLExecutionRDD [3603]<br>toJavaRDD at <unknown>:0"]; 3605 [labelType="html" label="PythonRDD [3605]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster8042 { label="MicroBatchScan"; 3591 [labelType="html" label="DataSourceRDD [3591]<br>run at <unknown>:0"]; 3592 [labelType="html" label="MapPartitionsRDD [3592]<br>run at <unknown>:0"]; } subgraph cluster8041 { label="Project"; 3593 [labelType="html" label="MapPartitionsRDD [3593]<br>run at <unknown>:0"]; } subgraph cluster8037 { label="WholeStageCodegen (1)"; 3594 [labelType="html" label="MapPartitionsRDD [3594]<br>run at <unknown>:0"]; } subgraph cluster8051 { label="WholeStageCodegen (1)"; 3596 [labelType="html" label="MapPartitionsRDD [3596]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8050 { label="Filter"; 3597 [labelType="html" label="MapPartitionsRDD [3597]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8049 { label="Project"; 3598 [labelType="html" label="MapPartitionsRDD [3598]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8046 { label="WholeStageCodegen (2)"; 3599 [labelType="html" label="MapPartitionsRDD [3599]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8045 { label="Project"; 3600 [labelType="html" label="MapPartitionsRDD [3600]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8044 { label="DeserializeToObject"; 3601 [labelType="html" label="MapPartitionsRDD [3601]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8043 { label="MapPartitions"; 3602 [labelType="html" label="MapPartitionsRDD [3602]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8053 { label="mapPartitions"; 3604 [labelType="html" label="MapPartitionsRDD [3604]<br>toJavaRDD at <unknown>:0"]; } } 3591->3592; 3592->3593; 3593->3594; 3594->3595; 3595->3596; 3596->3597; 3597->3598; 3598->3599; 3599->3600; 3600->3601; 3601->3602; 3602->3603; 3603->3604; 3604->3605; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time