3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2015 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 440
Associated Job Ids:
2016
DAG Visualization
digraph G { subgraph clusterstage_2015 { label="Stage 2015"; 21173 [labelType="html" label="SQLExecutionRDD [21173]<br>run at <unknown>:0"]; 21181 [labelType="html" label="SQLExecutionRDD [21181]<br>toJavaRDD at <unknown>:0"]; 21183 [labelType="html" label="PythonRDD [21183]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47377 { label="MicroBatchScan"; 21169 [labelType="html" label="DataSourceRDD [21169]<br>run at <unknown>:0"]; 21170 [labelType="html" label="MapPartitionsRDD [21170]<br>run at <unknown>:0"]; } subgraph cluster47376 { label="Project"; 21171 [labelType="html" label="MapPartitionsRDD [21171]<br>run at <unknown>:0"]; } subgraph cluster47372 { label="WholeStageCodegen (1)"; 21172 [labelType="html" label="MapPartitionsRDD [21172]<br>run at <unknown>:0"]; } subgraph cluster47386 { label="WholeStageCodegen (1)"; 21174 [labelType="html" label="MapPartitionsRDD [21174]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47385 { label="Filter"; 21175 [labelType="html" label="MapPartitionsRDD [21175]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47384 { label="Project"; 21176 [labelType="html" label="MapPartitionsRDD [21176]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47381 { label="WholeStageCodegen (2)"; 21177 [labelType="html" label="MapPartitionsRDD [21177]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47380 { label="Project"; 21178 [labelType="html" label="MapPartitionsRDD [21178]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47379 { label="DeserializeToObject"; 21179 [labelType="html" label="MapPartitionsRDD [21179]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47378 { label="MapPartitions"; 21180 [labelType="html" label="MapPartitionsRDD [21180]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47388 { label="mapPartitions"; 21182 [labelType="html" label="MapPartitionsRDD [21182]<br>toJavaRDD at <unknown>:0"]; } } 21169->21170; 21170->21171; 21171->21172; 21172->21173; 21173->21174; 21174->21175; 21175->21176; 21176->21177; 21177->21178; 21178->21179; 21179->21180; 21180->21181; 21181->21182; 21182->21183; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time