3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 907 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 385
Associated Job Ids:
908
DAG Visualization
digraph G { subgraph clusterstage_907 { label="Stage 907"; 9539 [labelType="html" label="SQLExecutionRDD [9539]<br>run at <unknown>:0"]; 9547 [labelType="html" label="SQLExecutionRDD [9547]<br>toJavaRDD at <unknown>:0"]; 9549 [labelType="html" label="PythonRDD [9549]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster21339 { label="MicroBatchScan"; 9535 [labelType="html" label="DataSourceRDD [9535]<br>run at <unknown>:0"]; 9536 [labelType="html" label="MapPartitionsRDD [9536]<br>run at <unknown>:0"]; } subgraph cluster21338 { label="Project"; 9537 [labelType="html" label="MapPartitionsRDD [9537]<br>run at <unknown>:0"]; } subgraph cluster21334 { label="WholeStageCodegen (1)"; 9538 [labelType="html" label="MapPartitionsRDD [9538]<br>run at <unknown>:0"]; } subgraph cluster21348 { label="WholeStageCodegen (1)"; 9540 [labelType="html" label="MapPartitionsRDD [9540]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21347 { label="Filter"; 9541 [labelType="html" label="MapPartitionsRDD [9541]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21346 { label="Project"; 9542 [labelType="html" label="MapPartitionsRDD [9542]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21343 { label="WholeStageCodegen (2)"; 9543 [labelType="html" label="MapPartitionsRDD [9543]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21342 { label="Project"; 9544 [labelType="html" label="MapPartitionsRDD [9544]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21341 { label="DeserializeToObject"; 9545 [labelType="html" label="MapPartitionsRDD [9545]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21340 { label="MapPartitions"; 9546 [labelType="html" label="MapPartitionsRDD [9546]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21350 { label="mapPartitions"; 9548 [labelType="html" label="MapPartitionsRDD [9548]<br>toJavaRDD at <unknown>:0"]; } } 9535->9536; 9536->9537; 9537->9538; 9538->9539; 9539->9540; 9540->9541; 9541->9542; 9542->9543; 9543->9544; 9544->9545; 9545->9546; 9546->9547; 9547->9548; 9548->9549; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time