3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 636 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 435
Associated Job Ids:
636
DAG Visualization
digraph G { subgraph clusterstage_636 { label="Stage 636"; 6682 [labelType="html" label="SQLExecutionRDD [6682]<br>run at <unknown>:0"]; 6690 [labelType="html" label="SQLExecutionRDD [6690]<br>toJavaRDD at <unknown>:0"]; 6692 [labelType="html" label="PythonRDD [6692]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14951 { label="MicroBatchScan"; 6678 [labelType="html" label="DataSourceRDD [6678]<br>run at <unknown>:0"]; 6679 [labelType="html" label="MapPartitionsRDD [6679]<br>run at <unknown>:0"]; } subgraph cluster14950 { label="Project"; 6680 [labelType="html" label="MapPartitionsRDD [6680]<br>run at <unknown>:0"]; } subgraph cluster14946 { label="WholeStageCodegen (1)"; 6681 [labelType="html" label="MapPartitionsRDD [6681]<br>run at <unknown>:0"]; } subgraph cluster14960 { label="WholeStageCodegen (1)"; 6683 [labelType="html" label="MapPartitionsRDD [6683]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14959 { label="Filter"; 6684 [labelType="html" label="MapPartitionsRDD [6684]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14958 { label="Project"; 6685 [labelType="html" label="MapPartitionsRDD [6685]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14955 { label="WholeStageCodegen (2)"; 6686 [labelType="html" label="MapPartitionsRDD [6686]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14954 { label="Project"; 6687 [labelType="html" label="MapPartitionsRDD [6687]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14953 { label="DeserializeToObject"; 6688 [labelType="html" label="MapPartitionsRDD [6688]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14952 { label="MapPartitions"; 6689 [labelType="html" label="MapPartitionsRDD [6689]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14962 { label="mapPartitions"; 6691 [labelType="html" label="MapPartitionsRDD [6691]<br>toJavaRDD at <unknown>:0"]; } } 6678->6679; 6679->6680; 6680->6681; 6681->6682; 6682->6683; 6683->6684; 6684->6685; 6685->6686; 6686->6687; 6687->6688; 6688->6689; 6689->6690; 6690->6691; 6691->6692; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time