3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 830 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 533
Associated Job Ids:
830
DAG Visualization
digraph G { subgraph clusterstage_830 { label="Stage 830"; 8719 [labelType="html" label="SQLExecutionRDD [8719]<br>run at <unknown>:0"]; 8727 [labelType="html" label="SQLExecutionRDD [8727]<br>toJavaRDD at <unknown>:0"]; 8729 [labelType="html" label="PythonRDD [8729]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster19510 { label="MicroBatchScan"; 8715 [labelType="html" label="DataSourceRDD [8715]<br>run at <unknown>:0"]; 8716 [labelType="html" label="MapPartitionsRDD [8716]<br>run at <unknown>:0"]; } subgraph cluster19509 { label="Project"; 8717 [labelType="html" label="MapPartitionsRDD [8717]<br>run at <unknown>:0"]; } subgraph cluster19505 { label="WholeStageCodegen (1)"; 8718 [labelType="html" label="MapPartitionsRDD [8718]<br>run at <unknown>:0"]; } subgraph cluster19519 { label="WholeStageCodegen (1)"; 8720 [labelType="html" label="MapPartitionsRDD [8720]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19518 { label="Filter"; 8721 [labelType="html" label="MapPartitionsRDD [8721]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19517 { label="Project"; 8722 [labelType="html" label="MapPartitionsRDD [8722]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19514 { label="WholeStageCodegen (2)"; 8723 [labelType="html" label="MapPartitionsRDD [8723]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19513 { label="Project"; 8724 [labelType="html" label="MapPartitionsRDD [8724]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19512 { label="DeserializeToObject"; 8725 [labelType="html" label="MapPartitionsRDD [8725]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19511 { label="MapPartitions"; 8726 [labelType="html" label="MapPartitionsRDD [8726]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19521 { label="mapPartitions"; 8728 [labelType="html" label="MapPartitionsRDD [8728]<br>toJavaRDD at <unknown>:0"]; } } 8715->8716; 8716->8717; 8717->8718; 8718->8719; 8719->8720; 8720->8721; 8721->8722; 8722->8723; 8723->8724; 8724->8725; 8725->8726; 8726->8727; 8727->8728; 8728->8729; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time