3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1842 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 448
Associated Job Ids:
1842
DAG Visualization
digraph G { subgraph clusterstage_1842 { label="Stage 1842"; 19345 [labelType="html" label="SQLExecutionRDD [19345]<br>run at <unknown>:0"]; 19353 [labelType="html" label="SQLExecutionRDD [19353]<br>toJavaRDD at <unknown>:0"]; 19355 [labelType="html" label="PythonRDD [19355]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster43292 { label="MicroBatchScan"; 19341 [labelType="html" label="DataSourceRDD [19341]<br>run at <unknown>:0"]; 19342 [labelType="html" label="MapPartitionsRDD [19342]<br>run at <unknown>:0"]; } subgraph cluster43291 { label="Project"; 19343 [labelType="html" label="MapPartitionsRDD [19343]<br>run at <unknown>:0"]; } subgraph cluster43287 { label="WholeStageCodegen (1)"; 19344 [labelType="html" label="MapPartitionsRDD [19344]<br>run at <unknown>:0"]; } subgraph cluster43301 { label="WholeStageCodegen (1)"; 19346 [labelType="html" label="MapPartitionsRDD [19346]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43300 { label="Filter"; 19347 [labelType="html" label="MapPartitionsRDD [19347]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43299 { label="Project"; 19348 [labelType="html" label="MapPartitionsRDD [19348]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43296 { label="WholeStageCodegen (2)"; 19349 [labelType="html" label="MapPartitionsRDD [19349]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43295 { label="Project"; 19350 [labelType="html" label="MapPartitionsRDD [19350]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43294 { label="DeserializeToObject"; 19351 [labelType="html" label="MapPartitionsRDD [19351]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43293 { label="MapPartitions"; 19352 [labelType="html" label="MapPartitionsRDD [19352]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43303 { label="mapPartitions"; 19354 [labelType="html" label="MapPartitionsRDD [19354]<br>toJavaRDD at <unknown>:0"]; } } 19341->19342; 19342->19343; 19343->19344; 19344->19345; 19345->19346; 19346->19347; 19347->19348; 19348->19349; 19349->19350; 19350->19351; 19351->19352; 19352->19353; 19353->19354; 19354->19355; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time