3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1286 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 496
Associated Job Ids:
1286
DAG Visualization
digraph G { subgraph clusterstage_1286 { label="Stage 1286"; 13507 [labelType="html" label="SQLExecutionRDD [13507]<br>run at <unknown>:0"]; 13515 [labelType="html" label="SQLExecutionRDD [13515]<br>toJavaRDD at <unknown>:0"]; 13517 [labelType="html" label="PythonRDD [13517]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30226 { label="MicroBatchScan"; 13503 [labelType="html" label="DataSourceRDD [13503]<br>run at <unknown>:0"]; 13504 [labelType="html" label="MapPartitionsRDD [13504]<br>run at <unknown>:0"]; } subgraph cluster30225 { label="Project"; 13505 [labelType="html" label="MapPartitionsRDD [13505]<br>run at <unknown>:0"]; } subgraph cluster30221 { label="WholeStageCodegen (1)"; 13506 [labelType="html" label="MapPartitionsRDD [13506]<br>run at <unknown>:0"]; } subgraph cluster30235 { label="WholeStageCodegen (1)"; 13508 [labelType="html" label="MapPartitionsRDD [13508]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30234 { label="Filter"; 13509 [labelType="html" label="MapPartitionsRDD [13509]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30233 { label="Project"; 13510 [labelType="html" label="MapPartitionsRDD [13510]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30230 { label="WholeStageCodegen (2)"; 13511 [labelType="html" label="MapPartitionsRDD [13511]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30229 { label="Project"; 13512 [labelType="html" label="MapPartitionsRDD [13512]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30228 { label="DeserializeToObject"; 13513 [labelType="html" label="MapPartitionsRDD [13513]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30227 { label="MapPartitions"; 13514 [labelType="html" label="MapPartitionsRDD [13514]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30237 { label="mapPartitions"; 13516 [labelType="html" label="MapPartitionsRDD [13516]<br>toJavaRDD at <unknown>:0"]; } } 13503->13504; 13504->13505; 13505->13506; 13506->13507; 13507->13508; 13508->13509; 13509->13510; 13510->13511; 13511->13512; 13512->13513; 13513->13514; 13514->13515; 13515->13516; 13516->13517; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time