3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 544 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 491
Associated Job Ids:
544
DAG Visualization
digraph G { subgraph clusterstage_544 { label="Stage 544"; 5716 [labelType="html" label="SQLExecutionRDD [5716]<br>run at <unknown>:0"]; 5724 [labelType="html" label="SQLExecutionRDD [5724]<br>toJavaRDD at <unknown>:0"]; 5726 [labelType="html" label="PythonRDD [5726]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster12789 { label="MicroBatchScan"; 5712 [labelType="html" label="DataSourceRDD [5712]<br>run at <unknown>:0"]; 5713 [labelType="html" label="MapPartitionsRDD [5713]<br>run at <unknown>:0"]; } subgraph cluster12788 { label="Project"; 5714 [labelType="html" label="MapPartitionsRDD [5714]<br>run at <unknown>:0"]; } subgraph cluster12784 { label="WholeStageCodegen (1)"; 5715 [labelType="html" label="MapPartitionsRDD [5715]<br>run at <unknown>:0"]; } subgraph cluster12798 { label="WholeStageCodegen (1)"; 5717 [labelType="html" label="MapPartitionsRDD [5717]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12797 { label="Filter"; 5718 [labelType="html" label="MapPartitionsRDD [5718]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12796 { label="Project"; 5719 [labelType="html" label="MapPartitionsRDD [5719]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12793 { label="WholeStageCodegen (2)"; 5720 [labelType="html" label="MapPartitionsRDD [5720]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12792 { label="Project"; 5721 [labelType="html" label="MapPartitionsRDD [5721]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12791 { label="DeserializeToObject"; 5722 [labelType="html" label="MapPartitionsRDD [5722]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12790 { label="MapPartitions"; 5723 [labelType="html" label="MapPartitionsRDD [5723]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12800 { label="mapPartitions"; 5725 [labelType="html" label="MapPartitionsRDD [5725]<br>toJavaRDD at <unknown>:0"]; } } 5712->5713; 5713->5714; 5714->5715; 5715->5716; 5716->5717; 5717->5718; 5718->5719; 5719->5720; 5720->5721; 5721->5722; 5722->5723; 5723->5724; 5724->5725; 5725->5726; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time