3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1884 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 383
Associated Job Ids:
1884
DAG Visualization
digraph G { subgraph clusterstage_1884 { label="Stage 1884"; 19786 [labelType="html" label="SQLExecutionRDD [19786]<br>run at <unknown>:0"]; 19794 [labelType="html" label="SQLExecutionRDD [19794]<br>toJavaRDD at <unknown>:0"]; 19796 [labelType="html" label="PythonRDD [19796]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster44279 { label="MicroBatchScan"; 19782 [labelType="html" label="DataSourceRDD [19782]<br>run at <unknown>:0"]; 19783 [labelType="html" label="MapPartitionsRDD [19783]<br>run at <unknown>:0"]; } subgraph cluster44278 { label="Project"; 19784 [labelType="html" label="MapPartitionsRDD [19784]<br>run at <unknown>:0"]; } subgraph cluster44274 { label="WholeStageCodegen (1)"; 19785 [labelType="html" label="MapPartitionsRDD [19785]<br>run at <unknown>:0"]; } subgraph cluster44288 { label="WholeStageCodegen (1)"; 19787 [labelType="html" label="MapPartitionsRDD [19787]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44287 { label="Filter"; 19788 [labelType="html" label="MapPartitionsRDD [19788]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44286 { label="Project"; 19789 [labelType="html" label="MapPartitionsRDD [19789]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44283 { label="WholeStageCodegen (2)"; 19790 [labelType="html" label="MapPartitionsRDD [19790]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44282 { label="Project"; 19791 [labelType="html" label="MapPartitionsRDD [19791]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44281 { label="DeserializeToObject"; 19792 [labelType="html" label="MapPartitionsRDD [19792]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44280 { label="MapPartitions"; 19793 [labelType="html" label="MapPartitionsRDD [19793]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44290 { label="mapPartitions"; 19795 [labelType="html" label="MapPartitionsRDD [19795]<br>toJavaRDD at <unknown>:0"]; } } 19782->19783; 19783->19784; 19784->19785; 19785->19786; 19786->19787; 19787->19788; 19788->19789; 19789->19790; 19790->19791; 19791->19792; 19792->19793; 19793->19794; 19794->19795; 19795->19796; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time