3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 770 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 469
Associated Job Ids:
770
DAG Visualization
digraph G { subgraph clusterstage_770 { label="Stage 770"; 8089 [labelType="html" label="SQLExecutionRDD [8089]<br>run at <unknown>:0"]; 8097 [labelType="html" label="SQLExecutionRDD [8097]<br>toJavaRDD at <unknown>:0"]; 8099 [labelType="html" label="PythonRDD [8099]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster18100 { label="MicroBatchScan"; 8085 [labelType="html" label="DataSourceRDD [8085]<br>run at <unknown>:0"]; 8086 [labelType="html" label="MapPartitionsRDD [8086]<br>run at <unknown>:0"]; } subgraph cluster18099 { label="Project"; 8087 [labelType="html" label="MapPartitionsRDD [8087]<br>run at <unknown>:0"]; } subgraph cluster18095 { label="WholeStageCodegen (1)"; 8088 [labelType="html" label="MapPartitionsRDD [8088]<br>run at <unknown>:0"]; } subgraph cluster18109 { label="WholeStageCodegen (1)"; 8090 [labelType="html" label="MapPartitionsRDD [8090]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18108 { label="Filter"; 8091 [labelType="html" label="MapPartitionsRDD [8091]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18107 { label="Project"; 8092 [labelType="html" label="MapPartitionsRDD [8092]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18104 { label="WholeStageCodegen (2)"; 8093 [labelType="html" label="MapPartitionsRDD [8093]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18103 { label="Project"; 8094 [labelType="html" label="MapPartitionsRDD [8094]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18102 { label="DeserializeToObject"; 8095 [labelType="html" label="MapPartitionsRDD [8095]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18101 { label="MapPartitions"; 8096 [labelType="html" label="MapPartitionsRDD [8096]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18111 { label="mapPartitions"; 8098 [labelType="html" label="MapPartitionsRDD [8098]<br>toJavaRDD at <unknown>:0"]; } } 8085->8086; 8086->8087; 8087->8088; 8088->8089; 8089->8090; 8090->8091; 8091->8092; 8092->8093; 8093->8094; 8094->8095; 8095->8096; 8096->8097; 8097->8098; 8098->8099; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time