3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 276 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 437
Associated Job Ids:
276
DAG Visualization
digraph G { subgraph clusterstage_276 { label="Stage 276"; 2902 [labelType="html" label="SQLExecutionRDD [2902]<br>run at <unknown>:0"]; 2910 [labelType="html" label="SQLExecutionRDD [2910]<br>toJavaRDD at <unknown>:0"]; 2912 [labelType="html" label="PythonRDD [2912]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6491 { label="MicroBatchScan"; 2898 [labelType="html" label="DataSourceRDD [2898]<br>run at <unknown>:0"]; 2899 [labelType="html" label="MapPartitionsRDD [2899]<br>run at <unknown>:0"]; } subgraph cluster6490 { label="Project"; 2900 [labelType="html" label="MapPartitionsRDD [2900]<br>run at <unknown>:0"]; } subgraph cluster6486 { label="WholeStageCodegen (1)"; 2901 [labelType="html" label="MapPartitionsRDD [2901]<br>run at <unknown>:0"]; } subgraph cluster6500 { label="WholeStageCodegen (1)"; 2903 [labelType="html" label="MapPartitionsRDD [2903]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6499 { label="Filter"; 2904 [labelType="html" label="MapPartitionsRDD [2904]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6498 { label="Project"; 2905 [labelType="html" label="MapPartitionsRDD [2905]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6495 { label="WholeStageCodegen (2)"; 2906 [labelType="html" label="MapPartitionsRDD [2906]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6494 { label="Project"; 2907 [labelType="html" label="MapPartitionsRDD [2907]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6493 { label="DeserializeToObject"; 2908 [labelType="html" label="MapPartitionsRDD [2908]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6492 { label="MapPartitions"; 2909 [labelType="html" label="MapPartitionsRDD [2909]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6502 { label="mapPartitions"; 2911 [labelType="html" label="MapPartitionsRDD [2911]<br>toJavaRDD at <unknown>:0"]; } } 2898->2899; 2899->2900; 2900->2901; 2901->2902; 2902->2903; 2903->2904; 2904->2905; 2905->2906; 2906->2907; 2907->2908; 2908->2909; 2909->2910; 2910->2911; 2911->2912; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time