3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 886 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 404
Associated Job Ids:
886
DAG Visualization
digraph G { subgraph clusterstage_886 { label="Stage 886"; 9307 [labelType="html" label="SQLExecutionRDD [9307]<br>run at <unknown>:0"]; 9315 [labelType="html" label="SQLExecutionRDD [9315]<br>toJavaRDD at <unknown>:0"]; 9317 [labelType="html" label="PythonRDD [9317]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20826 { label="MicroBatchScan"; 9303 [labelType="html" label="DataSourceRDD [9303]<br>run at <unknown>:0"]; 9304 [labelType="html" label="MapPartitionsRDD [9304]<br>run at <unknown>:0"]; } subgraph cluster20825 { label="Project"; 9305 [labelType="html" label="MapPartitionsRDD [9305]<br>run at <unknown>:0"]; } subgraph cluster20821 { label="WholeStageCodegen (1)"; 9306 [labelType="html" label="MapPartitionsRDD [9306]<br>run at <unknown>:0"]; } subgraph cluster20835 { label="WholeStageCodegen (1)"; 9308 [labelType="html" label="MapPartitionsRDD [9308]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20834 { label="Filter"; 9309 [labelType="html" label="MapPartitionsRDD [9309]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20833 { label="Project"; 9310 [labelType="html" label="MapPartitionsRDD [9310]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20830 { label="WholeStageCodegen (2)"; 9311 [labelType="html" label="MapPartitionsRDD [9311]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20829 { label="Project"; 9312 [labelType="html" label="MapPartitionsRDD [9312]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20828 { label="DeserializeToObject"; 9313 [labelType="html" label="MapPartitionsRDD [9313]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20827 { label="MapPartitions"; 9314 [labelType="html" label="MapPartitionsRDD [9314]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20837 { label="mapPartitions"; 9316 [labelType="html" label="MapPartitionsRDD [9316]<br>toJavaRDD at <unknown>:0"]; } } 9303->9304; 9304->9305; 9305->9306; 9306->9307; 9307->9308; 9308->9309; 9309->9310; 9310->9311; 9311->9312; 9312->9313; 9313->9314; 9314->9315; 9315->9316; 9316->9317; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time