3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 630 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 482
Associated Job Ids:
630
DAG Visualization
digraph G { subgraph clusterstage_630 { label="Stage 630"; 6619 [labelType="html" label="SQLExecutionRDD [6619]<br>run at <unknown>:0"]; 6627 [labelType="html" label="SQLExecutionRDD [6627]<br>toJavaRDD at <unknown>:0"]; 6629 [labelType="html" label="PythonRDD [6629]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14810 { label="MicroBatchScan"; 6615 [labelType="html" label="DataSourceRDD [6615]<br>run at <unknown>:0"]; 6616 [labelType="html" label="MapPartitionsRDD [6616]<br>run at <unknown>:0"]; } subgraph cluster14809 { label="Project"; 6617 [labelType="html" label="MapPartitionsRDD [6617]<br>run at <unknown>:0"]; } subgraph cluster14805 { label="WholeStageCodegen (1)"; 6618 [labelType="html" label="MapPartitionsRDD [6618]<br>run at <unknown>:0"]; } subgraph cluster14819 { label="WholeStageCodegen (1)"; 6620 [labelType="html" label="MapPartitionsRDD [6620]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14818 { label="Filter"; 6621 [labelType="html" label="MapPartitionsRDD [6621]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14817 { label="Project"; 6622 [labelType="html" label="MapPartitionsRDD [6622]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14814 { label="WholeStageCodegen (2)"; 6623 [labelType="html" label="MapPartitionsRDD [6623]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14813 { label="Project"; 6624 [labelType="html" label="MapPartitionsRDD [6624]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14812 { label="DeserializeToObject"; 6625 [labelType="html" label="MapPartitionsRDD [6625]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14811 { label="MapPartitions"; 6626 [labelType="html" label="MapPartitionsRDD [6626]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14821 { label="mapPartitions"; 6628 [labelType="html" label="MapPartitionsRDD [6628]<br>toJavaRDD at <unknown>:0"]; } } 6615->6616; 6616->6617; 6617->6618; 6618->6619; 6619->6620; 6620->6621; 6621->6622; 6622->6623; 6623->6624; 6624->6625; 6625->6626; 6626->6627; 6627->6628; 6628->6629; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time