3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1393 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 443
Associated Job Ids:
1394
DAG Visualization
digraph G { subgraph clusterstage_1393 { label="Stage 1393"; 14642 [labelType="html" label="SQLExecutionRDD [14642]<br>run at <unknown>:0"]; 14650 [labelType="html" label="SQLExecutionRDD [14650]<br>toJavaRDD at <unknown>:0"]; 14652 [labelType="html" label="PythonRDD [14652]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster32760 { label="MicroBatchScan"; 14638 [labelType="html" label="DataSourceRDD [14638]<br>run at <unknown>:0"]; 14639 [labelType="html" label="MapPartitionsRDD [14639]<br>run at <unknown>:0"]; } subgraph cluster32759 { label="Project"; 14640 [labelType="html" label="MapPartitionsRDD [14640]<br>run at <unknown>:0"]; } subgraph cluster32755 { label="WholeStageCodegen (1)"; 14641 [labelType="html" label="MapPartitionsRDD [14641]<br>run at <unknown>:0"]; } subgraph cluster32769 { label="WholeStageCodegen (1)"; 14643 [labelType="html" label="MapPartitionsRDD [14643]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32768 { label="Filter"; 14644 [labelType="html" label="MapPartitionsRDD [14644]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32767 { label="Project"; 14645 [labelType="html" label="MapPartitionsRDD [14645]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32764 { label="WholeStageCodegen (2)"; 14646 [labelType="html" label="MapPartitionsRDD [14646]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32763 { label="Project"; 14647 [labelType="html" label="MapPartitionsRDD [14647]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32762 { label="DeserializeToObject"; 14648 [labelType="html" label="MapPartitionsRDD [14648]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32761 { label="MapPartitions"; 14649 [labelType="html" label="MapPartitionsRDD [14649]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32771 { label="mapPartitions"; 14651 [labelType="html" label="MapPartitionsRDD [14651]<br>toJavaRDD at <unknown>:0"]; } } 14638->14639; 14639->14640; 14640->14641; 14641->14642; 14642->14643; 14643->14644; 14644->14645; 14645->14646; 14646->14647; 14647->14648; 14648->14649; 14649->14650; 14650->14651; 14651->14652; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time