3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1555 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 437
Associated Job Ids:
1556
DAG Visualization
digraph G { subgraph clusterstage_1555 { label="Stage 1555"; 16343 [labelType="html" label="SQLExecutionRDD [16343]<br>run at <unknown>:0"]; 16351 [labelType="html" label="SQLExecutionRDD [16351]<br>toJavaRDD at <unknown>:0"]; 16353 [labelType="html" label="PythonRDD [16353]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster36567 { label="MicroBatchScan"; 16339 [labelType="html" label="DataSourceRDD [16339]<br>run at <unknown>:0"]; 16340 [labelType="html" label="MapPartitionsRDD [16340]<br>run at <unknown>:0"]; } subgraph cluster36566 { label="Project"; 16341 [labelType="html" label="MapPartitionsRDD [16341]<br>run at <unknown>:0"]; } subgraph cluster36562 { label="WholeStageCodegen (1)"; 16342 [labelType="html" label="MapPartitionsRDD [16342]<br>run at <unknown>:0"]; } subgraph cluster36576 { label="WholeStageCodegen (1)"; 16344 [labelType="html" label="MapPartitionsRDD [16344]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36575 { label="Filter"; 16345 [labelType="html" label="MapPartitionsRDD [16345]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36574 { label="Project"; 16346 [labelType="html" label="MapPartitionsRDD [16346]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36571 { label="WholeStageCodegen (2)"; 16347 [labelType="html" label="MapPartitionsRDD [16347]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36570 { label="Project"; 16348 [labelType="html" label="MapPartitionsRDD [16348]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36569 { label="DeserializeToObject"; 16349 [labelType="html" label="MapPartitionsRDD [16349]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36568 { label="MapPartitions"; 16350 [labelType="html" label="MapPartitionsRDD [16350]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36578 { label="mapPartitions"; 16352 [labelType="html" label="MapPartitionsRDD [16352]<br>toJavaRDD at <unknown>:0"]; } } 16339->16340; 16340->16341; 16341->16342; 16342->16343; 16343->16344; 16344->16345; 16345->16346; 16346->16347; 16347->16348; 16348->16349; 16349->16350; 16350->16351; 16351->16352; 16352->16353; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time