3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 980 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 463
Associated Job Ids:
980
DAG Visualization
digraph G { subgraph clusterstage_980 { label="Stage 980"; 10294 [labelType="html" label="SQLExecutionRDD [10294]<br>run at <unknown>:0"]; 10302 [labelType="html" label="SQLExecutionRDD [10302]<br>toJavaRDD at <unknown>:0"]; 10304 [labelType="html" label="PythonRDD [10304]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster23035 { label="MicroBatchScan"; 10290 [labelType="html" label="DataSourceRDD [10290]<br>run at <unknown>:0"]; 10291 [labelType="html" label="MapPartitionsRDD [10291]<br>run at <unknown>:0"]; } subgraph cluster23034 { label="Project"; 10292 [labelType="html" label="MapPartitionsRDD [10292]<br>run at <unknown>:0"]; } subgraph cluster23030 { label="WholeStageCodegen (1)"; 10293 [labelType="html" label="MapPartitionsRDD [10293]<br>run at <unknown>:0"]; } subgraph cluster23044 { label="WholeStageCodegen (1)"; 10295 [labelType="html" label="MapPartitionsRDD [10295]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23043 { label="Filter"; 10296 [labelType="html" label="MapPartitionsRDD [10296]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23042 { label="Project"; 10297 [labelType="html" label="MapPartitionsRDD [10297]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23039 { label="WholeStageCodegen (2)"; 10298 [labelType="html" label="MapPartitionsRDD [10298]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23038 { label="Project"; 10299 [labelType="html" label="MapPartitionsRDD [10299]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23037 { label="DeserializeToObject"; 10300 [labelType="html" label="MapPartitionsRDD [10300]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23036 { label="MapPartitions"; 10301 [labelType="html" label="MapPartitionsRDD [10301]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23046 { label="mapPartitions"; 10303 [labelType="html" label="MapPartitionsRDD [10303]<br>toJavaRDD at <unknown>:0"]; } } 10290->10291; 10291->10292; 10292->10293; 10293->10294; 10294->10295; 10295->10296; 10296->10297; 10297->10298; 10298->10299; 10299->10300; 10300->10301; 10301->10302; 10302->10303; 10303->10304; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time