3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2031 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 463
Associated Job Ids:
2032
DAG Visualization
digraph G { subgraph clusterstage_2031 { label="Stage 2031"; 21341 [labelType="html" label="SQLExecutionRDD [21341]<br>run at <unknown>:0"]; 21349 [labelType="html" label="SQLExecutionRDD [21349]<br>toJavaRDD at <unknown>:0"]; 21351 [labelType="html" label="PythonRDD [21351]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47753 { label="MicroBatchScan"; 21337 [labelType="html" label="DataSourceRDD [21337]<br>run at <unknown>:0"]; 21338 [labelType="html" label="MapPartitionsRDD [21338]<br>run at <unknown>:0"]; } subgraph cluster47752 { label="Project"; 21339 [labelType="html" label="MapPartitionsRDD [21339]<br>run at <unknown>:0"]; } subgraph cluster47748 { label="WholeStageCodegen (1)"; 21340 [labelType="html" label="MapPartitionsRDD [21340]<br>run at <unknown>:0"]; } subgraph cluster47762 { label="WholeStageCodegen (1)"; 21342 [labelType="html" label="MapPartitionsRDD [21342]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47761 { label="Filter"; 21343 [labelType="html" label="MapPartitionsRDD [21343]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47760 { label="Project"; 21344 [labelType="html" label="MapPartitionsRDD [21344]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47757 { label="WholeStageCodegen (2)"; 21345 [labelType="html" label="MapPartitionsRDD [21345]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47756 { label="Project"; 21346 [labelType="html" label="MapPartitionsRDD [21346]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47755 { label="DeserializeToObject"; 21347 [labelType="html" label="MapPartitionsRDD [21347]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47754 { label="MapPartitions"; 21348 [labelType="html" label="MapPartitionsRDD [21348]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47764 { label="mapPartitions"; 21350 [labelType="html" label="MapPartitionsRDD [21350]<br>toJavaRDD at <unknown>:0"]; } } 21337->21338; 21338->21339; 21339->21340; 21340->21341; 21341->21342; 21342->21343; 21343->21344; 21344->21345; 21345->21346; 21346->21347; 21347->21348; 21348->21349; 21349->21350; 21350->21351; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time