3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 857 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 503
Associated Job Ids:
857
DAG Visualization
digraph G { subgraph clusterstage_857 { label="Stage 857"; 8998 [labelType="html" label="SQLExecutionRDD [8998]<br>run at <unknown>:0"]; 9006 [labelType="html" label="SQLExecutionRDD [9006]<br>toJavaRDD at <unknown>:0"]; 9008 [labelType="html" label="PythonRDD [9008]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20129 { label="MicroBatchScan"; 8989 [labelType="html" label="DataSourceRDD [8989]<br>run at <unknown>:0"]; 8991 [labelType="html" label="MapPartitionsRDD [8991]<br>run at <unknown>:0"]; } subgraph cluster20128 { label="Project"; 8993 [labelType="html" label="MapPartitionsRDD [8993]<br>run at <unknown>:0"]; } subgraph cluster20122 { label="WholeStageCodegen (1)"; 8996 [labelType="html" label="MapPartitionsRDD [8996]<br>run at <unknown>:0"]; } subgraph cluster20138 { label="WholeStageCodegen (1)"; 8999 [labelType="html" label="MapPartitionsRDD [8999]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20137 { label="Filter"; 9000 [labelType="html" label="MapPartitionsRDD [9000]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20136 { label="Project"; 9001 [labelType="html" label="MapPartitionsRDD [9001]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20133 { label="WholeStageCodegen (2)"; 9002 [labelType="html" label="MapPartitionsRDD [9002]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20132 { label="Project"; 9003 [labelType="html" label="MapPartitionsRDD [9003]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20131 { label="DeserializeToObject"; 9004 [labelType="html" label="MapPartitionsRDD [9004]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20130 { label="MapPartitions"; 9005 [labelType="html" label="MapPartitionsRDD [9005]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20140 { label="mapPartitions"; 9007 [labelType="html" label="MapPartitionsRDD [9007]<br>toJavaRDD at <unknown>:0"]; } } 8989->8991; 8991->8993; 8993->8996; 8996->8998; 8998->8999; 8999->9000; 9000->9001; 9001->9002; 9002->9003; 9003->9004; 9004->9005; 9005->9006; 9006->9007; 9007->9008; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time