3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 504 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 401
Associated Job Ids:
504
DAG Visualization
digraph G { subgraph clusterstage_504 { label="Stage 504"; 5296 [labelType="html" label="SQLExecutionRDD [5296]<br>run at <unknown>:0"]; 5304 [labelType="html" label="SQLExecutionRDD [5304]<br>toJavaRDD at <unknown>:0"]; 5306 [labelType="html" label="PythonRDD [5306]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11849 { label="MicroBatchScan"; 5292 [labelType="html" label="DataSourceRDD [5292]<br>run at <unknown>:0"]; 5293 [labelType="html" label="MapPartitionsRDD [5293]<br>run at <unknown>:0"]; } subgraph cluster11848 { label="Project"; 5294 [labelType="html" label="MapPartitionsRDD [5294]<br>run at <unknown>:0"]; } subgraph cluster11844 { label="WholeStageCodegen (1)"; 5295 [labelType="html" label="MapPartitionsRDD [5295]<br>run at <unknown>:0"]; } subgraph cluster11858 { label="WholeStageCodegen (1)"; 5297 [labelType="html" label="MapPartitionsRDD [5297]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11857 { label="Filter"; 5298 [labelType="html" label="MapPartitionsRDD [5298]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11856 { label="Project"; 5299 [labelType="html" label="MapPartitionsRDD [5299]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11853 { label="WholeStageCodegen (2)"; 5300 [labelType="html" label="MapPartitionsRDD [5300]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11852 { label="Project"; 5301 [labelType="html" label="MapPartitionsRDD [5301]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11851 { label="DeserializeToObject"; 5302 [labelType="html" label="MapPartitionsRDD [5302]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11850 { label="MapPartitions"; 5303 [labelType="html" label="MapPartitionsRDD [5303]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11860 { label="mapPartitions"; 5305 [labelType="html" label="MapPartitionsRDD [5305]<br>toJavaRDD at <unknown>:0"]; } } 5292->5293; 5293->5294; 5294->5295; 5295->5296; 5296->5297; 5297->5298; 5298->5299; 5299->5300; 5300->5301; 5301->5302; 5302->5303; 5303->5304; 5304->5305; 5305->5306; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time