3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 198 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 438
Associated Job Ids:
198
DAG Visualization
digraph G { subgraph clusterstage_198 { label="Stage 198"; 2083 [labelType="html" label="SQLExecutionRDD [2083]<br>run at <unknown>:0"]; 2091 [labelType="html" label="SQLExecutionRDD [2091]<br>toJavaRDD at <unknown>:0"]; 2093 [labelType="html" label="PythonRDD [2093]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster4658 { label="MicroBatchScan"; 2079 [labelType="html" label="DataSourceRDD [2079]<br>run at <unknown>:0"]; 2080 [labelType="html" label="MapPartitionsRDD [2080]<br>run at <unknown>:0"]; } subgraph cluster4657 { label="Project"; 2081 [labelType="html" label="MapPartitionsRDD [2081]<br>run at <unknown>:0"]; } subgraph cluster4653 { label="WholeStageCodegen (1)"; 2082 [labelType="html" label="MapPartitionsRDD [2082]<br>run at <unknown>:0"]; } subgraph cluster4667 { label="WholeStageCodegen (1)"; 2084 [labelType="html" label="MapPartitionsRDD [2084]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4666 { label="Filter"; 2085 [labelType="html" label="MapPartitionsRDD [2085]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4665 { label="Project"; 2086 [labelType="html" label="MapPartitionsRDD [2086]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4662 { label="WholeStageCodegen (2)"; 2087 [labelType="html" label="MapPartitionsRDD [2087]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4661 { label="Project"; 2088 [labelType="html" label="MapPartitionsRDD [2088]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4660 { label="DeserializeToObject"; 2089 [labelType="html" label="MapPartitionsRDD [2089]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4659 { label="MapPartitions"; 2090 [labelType="html" label="MapPartitionsRDD [2090]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4669 { label="mapPartitions"; 2092 [labelType="html" label="MapPartitionsRDD [2092]<br>toJavaRDD at <unknown>:0"]; } } 2079->2080; 2080->2081; 2081->2082; 2082->2083; 2083->2084; 2084->2085; 2085->2086; 2086->2087; 2087->2088; 2088->2089; 2089->2090; 2090->2091; 2091->2092; 2092->2093; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time