3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 93 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 444
Associated Job Ids:
93
DAG Visualization
digraph G { subgraph clusterstage_93 { label="Stage 93"; 976 [labelType="html" label="SQLExecutionRDD [976]<br>run at <unknown>:0"]; 984 [labelType="html" label="SQLExecutionRDD [984]<br>toJavaRDD at <unknown>:0"]; 986 [labelType="html" label="PythonRDD [986]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster2175 { label="MicroBatchScan"; 972 [labelType="html" label="DataSourceRDD [972]<br>run at <unknown>:0"]; 973 [labelType="html" label="MapPartitionsRDD [973]<br>run at <unknown>:0"]; } subgraph cluster2174 { label="Project"; 974 [labelType="html" label="MapPartitionsRDD [974]<br>run at <unknown>:0"]; } subgraph cluster2170 { label="WholeStageCodegen (1)"; 975 [labelType="html" label="MapPartitionsRDD [975]<br>run at <unknown>:0"]; } subgraph cluster2184 { label="WholeStageCodegen (1)"; 977 [labelType="html" label="MapPartitionsRDD [977]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2183 { label="Filter"; 978 [labelType="html" label="MapPartitionsRDD [978]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2182 { label="Project"; 979 [labelType="html" label="MapPartitionsRDD [979]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2179 { label="WholeStageCodegen (2)"; 980 [labelType="html" label="MapPartitionsRDD [980]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2178 { label="Project"; 981 [labelType="html" label="MapPartitionsRDD [981]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2177 { label="DeserializeToObject"; 982 [labelType="html" label="MapPartitionsRDD [982]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2176 { label="MapPartitions"; 983 [labelType="html" label="MapPartitionsRDD [983]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2186 { label="mapPartitions"; 985 [labelType="html" label="MapPartitionsRDD [985]<br>toJavaRDD at <unknown>:0"]; } } 972->973; 973->974; 974->975; 975->976; 976->977; 977->978; 978->979; 979->980; 980->981; 981->982; 982->983; 983->984; 984->985; 985->986; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time