3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 476 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 474
Associated Job Ids:
476
DAG Visualization
digraph G { subgraph clusterstage_476 { label="Stage 476"; 5002 [labelType="html" label="SQLExecutionRDD [5002]<br>run at <unknown>:0"]; 5010 [labelType="html" label="SQLExecutionRDD [5010]<br>toJavaRDD at <unknown>:0"]; 5012 [labelType="html" label="PythonRDD [5012]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11191 { label="MicroBatchScan"; 4998 [labelType="html" label="DataSourceRDD [4998]<br>run at <unknown>:0"]; 4999 [labelType="html" label="MapPartitionsRDD [4999]<br>run at <unknown>:0"]; } subgraph cluster11190 { label="Project"; 5000 [labelType="html" label="MapPartitionsRDD [5000]<br>run at <unknown>:0"]; } subgraph cluster11186 { label="WholeStageCodegen (1)"; 5001 [labelType="html" label="MapPartitionsRDD [5001]<br>run at <unknown>:0"]; } subgraph cluster11200 { label="WholeStageCodegen (1)"; 5003 [labelType="html" label="MapPartitionsRDD [5003]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11199 { label="Filter"; 5004 [labelType="html" label="MapPartitionsRDD [5004]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11198 { label="Project"; 5005 [labelType="html" label="MapPartitionsRDD [5005]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11195 { label="WholeStageCodegen (2)"; 5006 [labelType="html" label="MapPartitionsRDD [5006]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11194 { label="Project"; 5007 [labelType="html" label="MapPartitionsRDD [5007]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11193 { label="DeserializeToObject"; 5008 [labelType="html" label="MapPartitionsRDD [5008]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11192 { label="MapPartitions"; 5009 [labelType="html" label="MapPartitionsRDD [5009]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11202 { label="mapPartitions"; 5011 [labelType="html" label="MapPartitionsRDD [5011]<br>toJavaRDD at <unknown>:0"]; } } 4998->4999; 4999->5000; 5000->5001; 5001->5002; 5002->5003; 5003->5004; 5004->5005; 5005->5006; 5006->5007; 5007->5008; 5008->5009; 5009->5010; 5010->5011; 5011->5012; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time