3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 615 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 565
Associated Job Ids:
616
DAG Visualization
digraph G { subgraph clusterstage_615 { label="Stage 615"; 6473 [labelType="html" label="SQLExecutionRDD [6473]<br>run at <unknown>:0"]; 6481 [labelType="html" label="SQLExecutionRDD [6481]<br>toJavaRDD at <unknown>:0"]; 6483 [labelType="html" label="PythonRDD [6483]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14477 { label="MicroBatchScan"; 6469 [labelType="html" label="DataSourceRDD [6469]<br>run at <unknown>:0"]; 6470 [labelType="html" label="MapPartitionsRDD [6470]<br>run at <unknown>:0"]; } subgraph cluster14476 { label="Project"; 6471 [labelType="html" label="MapPartitionsRDD [6471]<br>run at <unknown>:0"]; } subgraph cluster14472 { label="WholeStageCodegen (1)"; 6472 [labelType="html" label="MapPartitionsRDD [6472]<br>run at <unknown>:0"]; } subgraph cluster14486 { label="WholeStageCodegen (1)"; 6474 [labelType="html" label="MapPartitionsRDD [6474]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14485 { label="Filter"; 6475 [labelType="html" label="MapPartitionsRDD [6475]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14484 { label="Project"; 6476 [labelType="html" label="MapPartitionsRDD [6476]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14481 { label="WholeStageCodegen (2)"; 6477 [labelType="html" label="MapPartitionsRDD [6477]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14480 { label="Project"; 6478 [labelType="html" label="MapPartitionsRDD [6478]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14479 { label="DeserializeToObject"; 6479 [labelType="html" label="MapPartitionsRDD [6479]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14478 { label="MapPartitions"; 6480 [labelType="html" label="MapPartitionsRDD [6480]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14488 { label="mapPartitions"; 6482 [labelType="html" label="MapPartitionsRDD [6482]<br>toJavaRDD at <unknown>:0"]; } } 6469->6470; 6470->6471; 6471->6472; 6472->6473; 6473->6474; 6474->6475; 6475->6476; 6476->6477; 6477->6478; 6478->6479; 6479->6480; 6480->6481; 6481->6482; 6482->6483; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time