3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2007 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 357
Associated Job Ids:
2008
DAG Visualization
digraph G { subgraph clusterstage_2007 { label="Stage 2007"; 21089 [labelType="html" label="SQLExecutionRDD [21089]<br>run at <unknown>:0"]; 21097 [labelType="html" label="SQLExecutionRDD [21097]<br>toJavaRDD at <unknown>:0"]; 21099 [labelType="html" label="PythonRDD [21099]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47189 { label="MicroBatchScan"; 21085 [labelType="html" label="DataSourceRDD [21085]<br>run at <unknown>:0"]; 21086 [labelType="html" label="MapPartitionsRDD [21086]<br>run at <unknown>:0"]; } subgraph cluster47188 { label="Project"; 21087 [labelType="html" label="MapPartitionsRDD [21087]<br>run at <unknown>:0"]; } subgraph cluster47184 { label="WholeStageCodegen (1)"; 21088 [labelType="html" label="MapPartitionsRDD [21088]<br>run at <unknown>:0"]; } subgraph cluster47198 { label="WholeStageCodegen (1)"; 21090 [labelType="html" label="MapPartitionsRDD [21090]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47197 { label="Filter"; 21091 [labelType="html" label="MapPartitionsRDD [21091]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47196 { label="Project"; 21092 [labelType="html" label="MapPartitionsRDD [21092]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47193 { label="WholeStageCodegen (2)"; 21093 [labelType="html" label="MapPartitionsRDD [21093]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47192 { label="Project"; 21094 [labelType="html" label="MapPartitionsRDD [21094]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47191 { label="DeserializeToObject"; 21095 [labelType="html" label="MapPartitionsRDD [21095]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47190 { label="MapPartitions"; 21096 [labelType="html" label="MapPartitionsRDD [21096]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47200 { label="mapPartitions"; 21098 [labelType="html" label="MapPartitionsRDD [21098]<br>toJavaRDD at <unknown>:0"]; } } 21085->21086; 21086->21087; 21087->21088; 21088->21089; 21089->21090; 21090->21091; 21091->21092; 21092->21093; 21093->21094; 21094->21095; 21095->21096; 21096->21097; 21097->21098; 21098->21099; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time