3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1299 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 519
Associated Job Ids:
1299
DAG Visualization
digraph G { subgraph clusterstage_1299 { label="Stage 1299"; 13639 [labelType="html" label="SQLExecutionRDD [13639]<br>run at <unknown>:0"]; 13647 [labelType="html" label="SQLExecutionRDD [13647]<br>toJavaRDD at <unknown>:0"]; 13649 [labelType="html" label="PythonRDD [13649]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30516 { label="MicroBatchScan"; 13635 [labelType="html" label="DataSourceRDD [13635]<br>run at <unknown>:0"]; 13636 [labelType="html" label="MapPartitionsRDD [13636]<br>run at <unknown>:0"]; } subgraph cluster30515 { label="Project"; 13637 [labelType="html" label="MapPartitionsRDD [13637]<br>run at <unknown>:0"]; } subgraph cluster30511 { label="WholeStageCodegen (1)"; 13638 [labelType="html" label="MapPartitionsRDD [13638]<br>run at <unknown>:0"]; } subgraph cluster30525 { label="WholeStageCodegen (1)"; 13640 [labelType="html" label="MapPartitionsRDD [13640]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30524 { label="Filter"; 13641 [labelType="html" label="MapPartitionsRDD [13641]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30523 { label="Project"; 13642 [labelType="html" label="MapPartitionsRDD [13642]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30520 { label="WholeStageCodegen (2)"; 13643 [labelType="html" label="MapPartitionsRDD [13643]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30519 { label="Project"; 13644 [labelType="html" label="MapPartitionsRDD [13644]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30518 { label="DeserializeToObject"; 13645 [labelType="html" label="MapPartitionsRDD [13645]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30517 { label="MapPartitions"; 13646 [labelType="html" label="MapPartitionsRDD [13646]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30527 { label="mapPartitions"; 13648 [labelType="html" label="MapPartitionsRDD [13648]<br>toJavaRDD at <unknown>:0"]; } } 13635->13636; 13636->13637; 13637->13638; 13638->13639; 13639->13640; 13640->13641; 13641->13642; 13642->13643; 13643->13644; 13644->13645; 13645->13646; 13646->13647; 13647->13648; 13648->13649; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time