3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 923 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 431
Associated Job Ids:
924
DAG Visualization
digraph G { subgraph clusterstage_923 { label="Stage 923"; 9707 [labelType="html" label="SQLExecutionRDD [9707]<br>run at <unknown>:0"]; 9715 [labelType="html" label="SQLExecutionRDD [9715]<br>toJavaRDD at <unknown>:0"]; 9717 [labelType="html" label="PythonRDD [9717]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster21715 { label="MicroBatchScan"; 9703 [labelType="html" label="DataSourceRDD [9703]<br>run at <unknown>:0"]; 9704 [labelType="html" label="MapPartitionsRDD [9704]<br>run at <unknown>:0"]; } subgraph cluster21714 { label="Project"; 9705 [labelType="html" label="MapPartitionsRDD [9705]<br>run at <unknown>:0"]; } subgraph cluster21710 { label="WholeStageCodegen (1)"; 9706 [labelType="html" label="MapPartitionsRDD [9706]<br>run at <unknown>:0"]; } subgraph cluster21724 { label="WholeStageCodegen (1)"; 9708 [labelType="html" label="MapPartitionsRDD [9708]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21723 { label="Filter"; 9709 [labelType="html" label="MapPartitionsRDD [9709]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21722 { label="Project"; 9710 [labelType="html" label="MapPartitionsRDD [9710]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21719 { label="WholeStageCodegen (2)"; 9711 [labelType="html" label="MapPartitionsRDD [9711]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21718 { label="Project"; 9712 [labelType="html" label="MapPartitionsRDD [9712]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21717 { label="DeserializeToObject"; 9713 [labelType="html" label="MapPartitionsRDD [9713]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21716 { label="MapPartitions"; 9714 [labelType="html" label="MapPartitionsRDD [9714]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21726 { label="mapPartitions"; 9716 [labelType="html" label="MapPartitionsRDD [9716]<br>toJavaRDD at <unknown>:0"]; } } 9703->9704; 9704->9705; 9705->9706; 9706->9707; 9707->9708; 9708->9709; 9709->9710; 9710->9711; 9711->9712; 9712->9713; 9713->9714; 9714->9715; 9715->9716; 9716->9717; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time