3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1488 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 483
Associated Job Ids:
1488
DAG Visualization
digraph G { subgraph clusterstage_1488 { label="Stage 1488"; 15628 [labelType="html" label="SQLExecutionRDD [15628]<br>run at <unknown>:0"]; 15636 [labelType="html" label="SQLExecutionRDD [15636]<br>toJavaRDD at <unknown>:0"]; 15638 [labelType="html" label="PythonRDD [15638]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster34973 { label="MicroBatchScan"; 15624 [labelType="html" label="DataSourceRDD [15624]<br>run at <unknown>:0"]; 15625 [labelType="html" label="MapPartitionsRDD [15625]<br>run at <unknown>:0"]; } subgraph cluster34972 { label="Project"; 15626 [labelType="html" label="MapPartitionsRDD [15626]<br>run at <unknown>:0"]; } subgraph cluster34968 { label="WholeStageCodegen (1)"; 15627 [labelType="html" label="MapPartitionsRDD [15627]<br>run at <unknown>:0"]; } subgraph cluster34982 { label="WholeStageCodegen (1)"; 15629 [labelType="html" label="MapPartitionsRDD [15629]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34981 { label="Filter"; 15630 [labelType="html" label="MapPartitionsRDD [15630]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34980 { label="Project"; 15631 [labelType="html" label="MapPartitionsRDD [15631]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34977 { label="WholeStageCodegen (2)"; 15632 [labelType="html" label="MapPartitionsRDD [15632]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34976 { label="Project"; 15633 [labelType="html" label="MapPartitionsRDD [15633]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34975 { label="DeserializeToObject"; 15634 [labelType="html" label="MapPartitionsRDD [15634]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34974 { label="MapPartitions"; 15635 [labelType="html" label="MapPartitionsRDD [15635]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34984 { label="mapPartitions"; 15637 [labelType="html" label="MapPartitionsRDD [15637]<br>toJavaRDD at <unknown>:0"]; } } 15624->15625; 15625->15626; 15626->15627; 15627->15628; 15628->15629; 15629->15630; 15630->15631; 15631->15632; 15632->15633; 15633->15634; 15634->15635; 15635->15636; 15636->15637; 15637->15638; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time