3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 574 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 388
Associated Job Ids:
574
DAG Visualization
digraph G { subgraph clusterstage_574 { label="Stage 574"; 6031 [labelType="html" label="SQLExecutionRDD [6031]<br>run at <unknown>:0"]; 6039 [labelType="html" label="SQLExecutionRDD [6039]<br>toJavaRDD at <unknown>:0"]; 6041 [labelType="html" label="PythonRDD [6041]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster13494 { label="MicroBatchScan"; 6027 [labelType="html" label="DataSourceRDD [6027]<br>run at <unknown>:0"]; 6028 [labelType="html" label="MapPartitionsRDD [6028]<br>run at <unknown>:0"]; } subgraph cluster13493 { label="Project"; 6029 [labelType="html" label="MapPartitionsRDD [6029]<br>run at <unknown>:0"]; } subgraph cluster13489 { label="WholeStageCodegen (1)"; 6030 [labelType="html" label="MapPartitionsRDD [6030]<br>run at <unknown>:0"]; } subgraph cluster13503 { label="WholeStageCodegen (1)"; 6032 [labelType="html" label="MapPartitionsRDD [6032]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13502 { label="Filter"; 6033 [labelType="html" label="MapPartitionsRDD [6033]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13501 { label="Project"; 6034 [labelType="html" label="MapPartitionsRDD [6034]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13498 { label="WholeStageCodegen (2)"; 6035 [labelType="html" label="MapPartitionsRDD [6035]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13497 { label="Project"; 6036 [labelType="html" label="MapPartitionsRDD [6036]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13496 { label="DeserializeToObject"; 6037 [labelType="html" label="MapPartitionsRDD [6037]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13495 { label="MapPartitions"; 6038 [labelType="html" label="MapPartitionsRDD [6038]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13505 { label="mapPartitions"; 6040 [labelType="html" label="MapPartitionsRDD [6040]<br>toJavaRDD at <unknown>:0"]; } } 6027->6028; 6028->6029; 6029->6030; 6030->6031; 6031->6032; 6032->6033; 6033->6034; 6034->6035; 6035->6036; 6036->6037; 6037->6038; 6038->6039; 6039->6040; 6040->6041; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time