3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 826 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 607
Associated Job Ids:
826
DAG Visualization
digraph G { subgraph clusterstage_826 { label="Stage 826"; 8677 [labelType="html" label="SQLExecutionRDD [8677]<br>run at <unknown>:0"]; 8685 [labelType="html" label="SQLExecutionRDD [8685]<br>toJavaRDD at <unknown>:0"]; 8687 [labelType="html" label="PythonRDD [8687]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster19416 { label="MicroBatchScan"; 8673 [labelType="html" label="DataSourceRDD [8673]<br>run at <unknown>:0"]; 8674 [labelType="html" label="MapPartitionsRDD [8674]<br>run at <unknown>:0"]; } subgraph cluster19415 { label="Project"; 8675 [labelType="html" label="MapPartitionsRDD [8675]<br>run at <unknown>:0"]; } subgraph cluster19411 { label="WholeStageCodegen (1)"; 8676 [labelType="html" label="MapPartitionsRDD [8676]<br>run at <unknown>:0"]; } subgraph cluster19425 { label="WholeStageCodegen (1)"; 8678 [labelType="html" label="MapPartitionsRDD [8678]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19424 { label="Filter"; 8679 [labelType="html" label="MapPartitionsRDD [8679]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19423 { label="Project"; 8680 [labelType="html" label="MapPartitionsRDD [8680]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19420 { label="WholeStageCodegen (2)"; 8681 [labelType="html" label="MapPartitionsRDD [8681]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19419 { label="Project"; 8682 [labelType="html" label="MapPartitionsRDD [8682]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19418 { label="DeserializeToObject"; 8683 [labelType="html" label="MapPartitionsRDD [8683]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19417 { label="MapPartitions"; 8684 [labelType="html" label="MapPartitionsRDD [8684]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19427 { label="mapPartitions"; 8686 [labelType="html" label="MapPartitionsRDD [8686]<br>toJavaRDD at <unknown>:0"]; } } 8673->8674; 8674->8675; 8675->8676; 8676->8677; 8677->8678; 8678->8679; 8679->8680; 8680->8681; 8681->8682; 8682->8683; 8683->8684; 8684->8685; 8685->8686; 8686->8687; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time