3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1010 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 450
Associated Job Ids:
1011
DAG Visualization
digraph G { subgraph clusterstage_1010 { label="Stage 1010"; 10616 [labelType="html" label="SQLExecutionRDD [10616]<br>run at <unknown>:0"]; 10624 [labelType="html" label="SQLExecutionRDD [10624]<br>toJavaRDD at <unknown>:0"]; 10626 [labelType="html" label="PythonRDD [10626]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster23744 { label="MicroBatchScan"; 10612 [labelType="html" label="DataSourceRDD [10612]<br>run at <unknown>:0"]; 10613 [labelType="html" label="MapPartitionsRDD [10613]<br>run at <unknown>:0"]; } subgraph cluster23743 { label="Project"; 10614 [labelType="html" label="MapPartitionsRDD [10614]<br>run at <unknown>:0"]; } subgraph cluster23739 { label="WholeStageCodegen (1)"; 10615 [labelType="html" label="MapPartitionsRDD [10615]<br>run at <unknown>:0"]; } subgraph cluster23753 { label="WholeStageCodegen (1)"; 10617 [labelType="html" label="MapPartitionsRDD [10617]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23752 { label="Filter"; 10618 [labelType="html" label="MapPartitionsRDD [10618]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23751 { label="Project"; 10619 [labelType="html" label="MapPartitionsRDD [10619]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23748 { label="WholeStageCodegen (2)"; 10620 [labelType="html" label="MapPartitionsRDD [10620]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23747 { label="Project"; 10621 [labelType="html" label="MapPartitionsRDD [10621]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23746 { label="DeserializeToObject"; 10622 [labelType="html" label="MapPartitionsRDD [10622]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23745 { label="MapPartitions"; 10623 [labelType="html" label="MapPartitionsRDD [10623]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster23755 { label="mapPartitions"; 10625 [labelType="html" label="MapPartitionsRDD [10625]<br>toJavaRDD at <unknown>:0"]; } } 10612->10613; 10613->10614; 10614->10615; 10615->10616; 10616->10617; 10617->10618; 10618->10619; 10619->10620; 10620->10621; 10621->10622; 10622->10623; 10623->10624; 10624->10625; 10625->10626; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time