3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1313 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 396
Associated Job Ids:
1313
DAG Visualization
digraph G { subgraph clusterstage_1313 { label="Stage 1313"; 13780 [labelType="html" label="SQLExecutionRDD [13780]<br>run at <unknown>:0"]; 13794 [labelType="html" label="SQLExecutionRDD [13794]<br>toJavaRDD at <unknown>:0"]; 13796 [labelType="html" label="PythonRDD [13796]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30837 { label="MicroBatchScan"; 13776 [labelType="html" label="DataSourceRDD [13776]<br>run at <unknown>:0"]; 13777 [labelType="html" label="MapPartitionsRDD [13777]<br>run at <unknown>:0"]; } subgraph cluster30836 { label="Project"; 13778 [labelType="html" label="MapPartitionsRDD [13778]<br>run at <unknown>:0"]; } subgraph cluster30832 { label="WholeStageCodegen (1)"; 13779 [labelType="html" label="MapPartitionsRDD [13779]<br>run at <unknown>:0"]; } subgraph cluster30854 { label="WholeStageCodegen (1)"; 13787 [labelType="html" label="MapPartitionsRDD [13787]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30853 { label="Filter"; 13788 [labelType="html" label="MapPartitionsRDD [13788]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30852 { label="Project"; 13789 [labelType="html" label="MapPartitionsRDD [13789]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30849 { label="WholeStageCodegen (2)"; 13790 [labelType="html" label="MapPartitionsRDD [13790]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30848 { label="Project"; 13791 [labelType="html" label="MapPartitionsRDD [13791]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30847 { label="DeserializeToObject"; 13792 [labelType="html" label="MapPartitionsRDD [13792]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30846 { label="MapPartitions"; 13793 [labelType="html" label="MapPartitionsRDD [13793]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30856 { label="mapPartitions"; 13795 [labelType="html" label="MapPartitionsRDD [13795]<br>toJavaRDD at <unknown>:0"]; } } 13776->13777; 13777->13778; 13778->13779; 13779->13780; 13780->13787; 13787->13788; 13788->13789; 13789->13790; 13790->13791; 13791->13792; 13792->13793; 13793->13794; 13794->13795; 13795->13796; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time