3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1119 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 467
Associated Job Ids:
1120
DAG Visualization
digraph G { subgraph clusterstage_1119 { label="Stage 1119"; 11765 [labelType="html" label="SQLExecutionRDD [11765]<br>run at <unknown>:0"]; 11773 [labelType="html" label="SQLExecutionRDD [11773]<br>toJavaRDD at <unknown>:0"]; 11775 [labelType="html" label="PythonRDD [11775]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26321 { label="MicroBatchScan"; 11761 [labelType="html" label="DataSourceRDD [11761]<br>run at <unknown>:0"]; 11762 [labelType="html" label="MapPartitionsRDD [11762]<br>run at <unknown>:0"]; } subgraph cluster26320 { label="Project"; 11763 [labelType="html" label="MapPartitionsRDD [11763]<br>run at <unknown>:0"]; } subgraph cluster26316 { label="WholeStageCodegen (1)"; 11764 [labelType="html" label="MapPartitionsRDD [11764]<br>run at <unknown>:0"]; } subgraph cluster26330 { label="WholeStageCodegen (1)"; 11766 [labelType="html" label="MapPartitionsRDD [11766]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26329 { label="Filter"; 11767 [labelType="html" label="MapPartitionsRDD [11767]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26328 { label="Project"; 11768 [labelType="html" label="MapPartitionsRDD [11768]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26325 { label="WholeStageCodegen (2)"; 11769 [labelType="html" label="MapPartitionsRDD [11769]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26324 { label="Project"; 11770 [labelType="html" label="MapPartitionsRDD [11770]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26323 { label="DeserializeToObject"; 11771 [labelType="html" label="MapPartitionsRDD [11771]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26322 { label="MapPartitions"; 11772 [labelType="html" label="MapPartitionsRDD [11772]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26332 { label="mapPartitions"; 11774 [labelType="html" label="MapPartitionsRDD [11774]<br>toJavaRDD at <unknown>:0"]; } } 11761->11762; 11762->11763; 11763->11764; 11764->11765; 11765->11766; 11766->11767; 11767->11768; 11768->11769; 11769->11770; 11770->11771; 11771->11772; 11772->11773; 11773->11774; 11774->11775; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time