3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 223 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 341
Associated Job Ids:
223
DAG Visualization
digraph G { subgraph clusterstage_223 { label="Stage 223"; 2335 [labelType="html" label="SQLExecutionRDD [2335]<br>run at <unknown>:0"]; 2349 [labelType="html" label="SQLExecutionRDD [2349]<br>toJavaRDD at <unknown>:0"]; 2351 [labelType="html" label="PythonRDD [2351]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster5222 { label="MicroBatchScan"; 2331 [labelType="html" label="DataSourceRDD [2331]<br>run at <unknown>:0"]; 2332 [labelType="html" label="MapPartitionsRDD [2332]<br>run at <unknown>:0"]; } subgraph cluster5221 { label="Project"; 2333 [labelType="html" label="MapPartitionsRDD [2333]<br>run at <unknown>:0"]; } subgraph cluster5217 { label="WholeStageCodegen (1)"; 2334 [labelType="html" label="MapPartitionsRDD [2334]<br>run at <unknown>:0"]; } subgraph cluster5239 { label="WholeStageCodegen (1)"; 2342 [labelType="html" label="MapPartitionsRDD [2342]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5238 { label="Filter"; 2343 [labelType="html" label="MapPartitionsRDD [2343]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5237 { label="Project"; 2344 [labelType="html" label="MapPartitionsRDD [2344]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5234 { label="WholeStageCodegen (2)"; 2345 [labelType="html" label="MapPartitionsRDD [2345]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5233 { label="Project"; 2346 [labelType="html" label="MapPartitionsRDD [2346]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5232 { label="DeserializeToObject"; 2347 [labelType="html" label="MapPartitionsRDD [2347]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5231 { label="MapPartitions"; 2348 [labelType="html" label="MapPartitionsRDD [2348]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5241 { label="mapPartitions"; 2350 [labelType="html" label="MapPartitionsRDD [2350]<br>toJavaRDD at <unknown>:0"]; } } 2331->2332; 2332->2333; 2333->2334; 2334->2335; 2335->2342; 2342->2343; 2343->2344; 2344->2345; 2345->2346; 2346->2347; 2347->2348; 2348->2349; 2349->2350; 2350->2351; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time