3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1218 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 456
Associated Job Ids:
1219
DAG Visualization
digraph G { subgraph clusterstage_1218 { label="Stage 1218"; 12800 [labelType="html" label="SQLExecutionRDD [12800]<br>run at <unknown>:0"]; 12808 [labelType="html" label="SQLExecutionRDD [12808]<br>toJavaRDD at <unknown>:0"]; 12810 [labelType="html" label="PythonRDD [12810]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster28632 { label="MicroBatchScan"; 12796 [labelType="html" label="DataSourceRDD [12796]<br>run at <unknown>:0"]; 12797 [labelType="html" label="MapPartitionsRDD [12797]<br>run at <unknown>:0"]; } subgraph cluster28631 { label="Project"; 12798 [labelType="html" label="MapPartitionsRDD [12798]<br>run at <unknown>:0"]; } subgraph cluster28627 { label="WholeStageCodegen (1)"; 12799 [labelType="html" label="MapPartitionsRDD [12799]<br>run at <unknown>:0"]; } subgraph cluster28641 { label="WholeStageCodegen (1)"; 12801 [labelType="html" label="MapPartitionsRDD [12801]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28640 { label="Filter"; 12802 [labelType="html" label="MapPartitionsRDD [12802]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28639 { label="Project"; 12803 [labelType="html" label="MapPartitionsRDD [12803]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28636 { label="WholeStageCodegen (2)"; 12804 [labelType="html" label="MapPartitionsRDD [12804]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28635 { label="Project"; 12805 [labelType="html" label="MapPartitionsRDD [12805]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28634 { label="DeserializeToObject"; 12806 [labelType="html" label="MapPartitionsRDD [12806]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28633 { label="MapPartitions"; 12807 [labelType="html" label="MapPartitionsRDD [12807]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28643 { label="mapPartitions"; 12809 [labelType="html" label="MapPartitionsRDD [12809]<br>toJavaRDD at <unknown>:0"]; } } 12796->12797; 12797->12798; 12798->12799; 12799->12800; 12800->12801; 12801->12802; 12802->12803; 12803->12804; 12804->12805; 12805->12806; 12806->12807; 12807->12808; 12808->12809; 12809->12810; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time