3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1338 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 441
Associated Job Ids:
1338
DAG Visualization
digraph G { subgraph clusterstage_1338 { label="Stage 1338"; 14053 [labelType="html" label="SQLExecutionRDD [14053]<br>run at <unknown>:0"]; 14061 [labelType="html" label="SQLExecutionRDD [14061]<br>toJavaRDD at <unknown>:0"]; 14063 [labelType="html" label="PythonRDD [14063]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster31448 { label="MicroBatchScan"; 14049 [labelType="html" label="DataSourceRDD [14049]<br>run at <unknown>:0"]; 14050 [labelType="html" label="MapPartitionsRDD [14050]<br>run at <unknown>:0"]; } subgraph cluster31447 { label="Project"; 14051 [labelType="html" label="MapPartitionsRDD [14051]<br>run at <unknown>:0"]; } subgraph cluster31443 { label="WholeStageCodegen (1)"; 14052 [labelType="html" label="MapPartitionsRDD [14052]<br>run at <unknown>:0"]; } subgraph cluster31457 { label="WholeStageCodegen (1)"; 14054 [labelType="html" label="MapPartitionsRDD [14054]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31456 { label="Filter"; 14055 [labelType="html" label="MapPartitionsRDD [14055]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31455 { label="Project"; 14056 [labelType="html" label="MapPartitionsRDD [14056]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31452 { label="WholeStageCodegen (2)"; 14057 [labelType="html" label="MapPartitionsRDD [14057]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31451 { label="Project"; 14058 [labelType="html" label="MapPartitionsRDD [14058]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31450 { label="DeserializeToObject"; 14059 [labelType="html" label="MapPartitionsRDD [14059]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31449 { label="MapPartitions"; 14060 [labelType="html" label="MapPartitionsRDD [14060]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31459 { label="mapPartitions"; 14062 [labelType="html" label="MapPartitionsRDD [14062]<br>toJavaRDD at <unknown>:0"]; } } 14049->14050; 14050->14051; 14051->14052; 14052->14053; 14053->14054; 14054->14055; 14055->14056; 14056->14057; 14057->14058; 14058->14059; 14059->14060; 14060->14061; 14061->14062; 14062->14063; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time