3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 413 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 484
Associated Job Ids:
413
DAG Visualization
digraph G { subgraph clusterstage_413 { label="Stage 413"; 4330 [labelType="html" label="SQLExecutionRDD [4330]<br>run at <unknown>:0"]; 4344 [labelType="html" label="SQLExecutionRDD [4344]<br>toJavaRDD at <unknown>:0"]; 4346 [labelType="html" label="PythonRDD [4346]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9687 { label="MicroBatchScan"; 4326 [labelType="html" label="DataSourceRDD [4326]<br>run at <unknown>:0"]; 4327 [labelType="html" label="MapPartitionsRDD [4327]<br>run at <unknown>:0"]; } subgraph cluster9686 { label="Project"; 4328 [labelType="html" label="MapPartitionsRDD [4328]<br>run at <unknown>:0"]; } subgraph cluster9682 { label="WholeStageCodegen (1)"; 4329 [labelType="html" label="MapPartitionsRDD [4329]<br>run at <unknown>:0"]; } subgraph cluster9704 { label="WholeStageCodegen (1)"; 4337 [labelType="html" label="MapPartitionsRDD [4337]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9703 { label="Filter"; 4338 [labelType="html" label="MapPartitionsRDD [4338]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9702 { label="Project"; 4339 [labelType="html" label="MapPartitionsRDD [4339]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9699 { label="WholeStageCodegen (2)"; 4340 [labelType="html" label="MapPartitionsRDD [4340]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9698 { label="Project"; 4341 [labelType="html" label="MapPartitionsRDD [4341]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9697 { label="DeserializeToObject"; 4342 [labelType="html" label="MapPartitionsRDD [4342]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9696 { label="MapPartitions"; 4343 [labelType="html" label="MapPartitionsRDD [4343]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9706 { label="mapPartitions"; 4345 [labelType="html" label="MapPartitionsRDD [4345]<br>toJavaRDD at <unknown>:0"]; } } 4326->4327; 4327->4328; 4328->4329; 4329->4330; 4330->4337; 4337->4338; 4338->4339; 4339->4340; 4340->4341; 4341->4342; 4342->4343; 4343->4344; 4344->4345; 4345->4346; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time