3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1314 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 470
Associated Job Ids:
1314
DAG Visualization
digraph G { subgraph clusterstage_1314 { label="Stage 1314"; 13801 [labelType="html" label="SQLExecutionRDD [13801]<br>run at <unknown>:0"]; 13809 [labelType="html" label="SQLExecutionRDD [13809]<br>toJavaRDD at <unknown>:0"]; 13811 [labelType="html" label="PythonRDD [13811]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30884 { label="MicroBatchScan"; 13797 [labelType="html" label="DataSourceRDD [13797]<br>run at <unknown>:0"]; 13798 [labelType="html" label="MapPartitionsRDD [13798]<br>run at <unknown>:0"]; } subgraph cluster30883 { label="Project"; 13799 [labelType="html" label="MapPartitionsRDD [13799]<br>run at <unknown>:0"]; } subgraph cluster30879 { label="WholeStageCodegen (1)"; 13800 [labelType="html" label="MapPartitionsRDD [13800]<br>run at <unknown>:0"]; } subgraph cluster30893 { label="WholeStageCodegen (1)"; 13802 [labelType="html" label="MapPartitionsRDD [13802]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30892 { label="Filter"; 13803 [labelType="html" label="MapPartitionsRDD [13803]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30891 { label="Project"; 13804 [labelType="html" label="MapPartitionsRDD [13804]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30888 { label="WholeStageCodegen (2)"; 13805 [labelType="html" label="MapPartitionsRDD [13805]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30887 { label="Project"; 13806 [labelType="html" label="MapPartitionsRDD [13806]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30886 { label="DeserializeToObject"; 13807 [labelType="html" label="MapPartitionsRDD [13807]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30885 { label="MapPartitions"; 13808 [labelType="html" label="MapPartitionsRDD [13808]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30895 { label="mapPartitions"; 13810 [labelType="html" label="MapPartitionsRDD [13810]<br>toJavaRDD at <unknown>:0"]; } } 13797->13798; 13798->13799; 13799->13800; 13800->13801; 13801->13802; 13802->13803; 13803->13804; 13804->13805; 13805->13806; 13806->13807; 13807->13808; 13808->13809; 13809->13810; 13810->13811; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time