3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 72 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 507
Associated Job Ids:
72
DAG Visualization
digraph G { subgraph clusterstage_72 { label="Stage 72"; 760 [labelType="html" label="SQLExecutionRDD [760]<br>run at <unknown>:0"]; 768 [labelType="html" label="SQLExecutionRDD [768]<br>toJavaRDD at <unknown>:0"]; 770 [labelType="html" label="PythonRDD [770]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster1697 { label="MicroBatchScan"; 756 [labelType="html" label="DataSourceRDD [756]<br>run at <unknown>:0"]; 757 [labelType="html" label="MapPartitionsRDD [757]<br>run at <unknown>:0"]; } subgraph cluster1696 { label="Project"; 758 [labelType="html" label="MapPartitionsRDD [758]<br>run at <unknown>:0"]; } subgraph cluster1692 { label="WholeStageCodegen (1)"; 759 [labelType="html" label="MapPartitionsRDD [759]<br>run at <unknown>:0"]; } subgraph cluster1706 { label="WholeStageCodegen (1)"; 761 [labelType="html" label="MapPartitionsRDD [761]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1705 { label="Filter"; 762 [labelType="html" label="MapPartitionsRDD [762]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1704 { label="Project"; 763 [labelType="html" label="MapPartitionsRDD [763]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1701 { label="WholeStageCodegen (2)"; 764 [labelType="html" label="MapPartitionsRDD [764]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1700 { label="Project"; 765 [labelType="html" label="MapPartitionsRDD [765]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1699 { label="DeserializeToObject"; 766 [labelType="html" label="MapPartitionsRDD [766]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1698 { label="MapPartitions"; 767 [labelType="html" label="MapPartitionsRDD [767]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1708 { label="mapPartitions"; 769 [labelType="html" label="MapPartitionsRDD [769]<br>toJavaRDD at <unknown>:0"]; } } 756->757; 757->758; 758->759; 759->760; 760->761; 761->762; 762->763; 763->764; 764->765; 765->766; 766->767; 767->768; 768->769; 769->770; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time