3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1389 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 466
Associated Job Ids:
1390
DAG Visualization
digraph G { subgraph clusterstage_1389 { label="Stage 1389"; 14600 [labelType="html" label="SQLExecutionRDD [14600]<br>run at <unknown>:0"]; 14608 [labelType="html" label="SQLExecutionRDD [14608]<br>toJavaRDD at <unknown>:0"]; 14610 [labelType="html" label="PythonRDD [14610]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster32666 { label="MicroBatchScan"; 14596 [labelType="html" label="DataSourceRDD [14596]<br>run at <unknown>:0"]; 14597 [labelType="html" label="MapPartitionsRDD [14597]<br>run at <unknown>:0"]; } subgraph cluster32665 { label="Project"; 14598 [labelType="html" label="MapPartitionsRDD [14598]<br>run at <unknown>:0"]; } subgraph cluster32661 { label="WholeStageCodegen (1)"; 14599 [labelType="html" label="MapPartitionsRDD [14599]<br>run at <unknown>:0"]; } subgraph cluster32675 { label="WholeStageCodegen (1)"; 14601 [labelType="html" label="MapPartitionsRDD [14601]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32674 { label="Filter"; 14602 [labelType="html" label="MapPartitionsRDD [14602]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32673 { label="Project"; 14603 [labelType="html" label="MapPartitionsRDD [14603]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32670 { label="WholeStageCodegen (2)"; 14604 [labelType="html" label="MapPartitionsRDD [14604]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32669 { label="Project"; 14605 [labelType="html" label="MapPartitionsRDD [14605]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32668 { label="DeserializeToObject"; 14606 [labelType="html" label="MapPartitionsRDD [14606]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32667 { label="MapPartitions"; 14607 [labelType="html" label="MapPartitionsRDD [14607]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32677 { label="mapPartitions"; 14609 [labelType="html" label="MapPartitionsRDD [14609]<br>toJavaRDD at <unknown>:0"]; } } 14596->14597; 14597->14598; 14598->14599; 14599->14600; 14600->14601; 14601->14602; 14602->14603; 14603->14604; 14604->14605; 14605->14606; 14606->14607; 14607->14608; 14608->14609; 14609->14610; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time