3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1311 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 530
Associated Job Ids:
1311
DAG Visualization
digraph G { subgraph clusterstage_1311 { label="Stage 1311"; 13765 [labelType="html" label="SQLExecutionRDD [13765]<br>run at <unknown>:0"]; 13773 [labelType="html" label="SQLExecutionRDD [13773]<br>toJavaRDD at <unknown>:0"]; 13775 [labelType="html" label="PythonRDD [13775]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30798 { label="MicroBatchScan"; 13761 [labelType="html" label="DataSourceRDD [13761]<br>run at <unknown>:0"]; 13762 [labelType="html" label="MapPartitionsRDD [13762]<br>run at <unknown>:0"]; } subgraph cluster30797 { label="Project"; 13763 [labelType="html" label="MapPartitionsRDD [13763]<br>run at <unknown>:0"]; } subgraph cluster30793 { label="WholeStageCodegen (1)"; 13764 [labelType="html" label="MapPartitionsRDD [13764]<br>run at <unknown>:0"]; } subgraph cluster30807 { label="WholeStageCodegen (1)"; 13766 [labelType="html" label="MapPartitionsRDD [13766]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30806 { label="Filter"; 13767 [labelType="html" label="MapPartitionsRDD [13767]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30805 { label="Project"; 13768 [labelType="html" label="MapPartitionsRDD [13768]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30802 { label="WholeStageCodegen (2)"; 13769 [labelType="html" label="MapPartitionsRDD [13769]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30801 { label="Project"; 13770 [labelType="html" label="MapPartitionsRDD [13770]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30800 { label="DeserializeToObject"; 13771 [labelType="html" label="MapPartitionsRDD [13771]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30799 { label="MapPartitions"; 13772 [labelType="html" label="MapPartitionsRDD [13772]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30809 { label="mapPartitions"; 13774 [labelType="html" label="MapPartitionsRDD [13774]<br>toJavaRDD at <unknown>:0"]; } } 13761->13762; 13762->13763; 13763->13764; 13764->13765; 13765->13766; 13766->13767; 13767->13768; 13768->13769; 13769->13770; 13770->13771; 13771->13772; 13772->13773; 13773->13774; 13774->13775; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time