3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1713 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 475
Associated Job Ids:
1714
DAG Visualization
digraph G { subgraph clusterstage_1713 { label="Stage 1713"; 18002 [labelType="html" label="SQLExecutionRDD [18002]<br>run at <unknown>:0"]; 18010 [labelType="html" label="SQLExecutionRDD [18010]<br>toJavaRDD at <unknown>:0"]; 18012 [labelType="html" label="PythonRDD [18012]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster40280 { label="MicroBatchScan"; 17998 [labelType="html" label="DataSourceRDD [17998]<br>run at <unknown>:0"]; 17999 [labelType="html" label="MapPartitionsRDD [17999]<br>run at <unknown>:0"]; } subgraph cluster40279 { label="Project"; 18000 [labelType="html" label="MapPartitionsRDD [18000]<br>run at <unknown>:0"]; } subgraph cluster40275 { label="WholeStageCodegen (1)"; 18001 [labelType="html" label="MapPartitionsRDD [18001]<br>run at <unknown>:0"]; } subgraph cluster40289 { label="WholeStageCodegen (1)"; 18003 [labelType="html" label="MapPartitionsRDD [18003]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40288 { label="Filter"; 18004 [labelType="html" label="MapPartitionsRDD [18004]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40287 { label="Project"; 18005 [labelType="html" label="MapPartitionsRDD [18005]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40284 { label="WholeStageCodegen (2)"; 18006 [labelType="html" label="MapPartitionsRDD [18006]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40283 { label="Project"; 18007 [labelType="html" label="MapPartitionsRDD [18007]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40282 { label="DeserializeToObject"; 18008 [labelType="html" label="MapPartitionsRDD [18008]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40281 { label="MapPartitions"; 18009 [labelType="html" label="MapPartitionsRDD [18009]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40291 { label="mapPartitions"; 18011 [labelType="html" label="MapPartitionsRDD [18011]<br>toJavaRDD at <unknown>:0"]; } } 17998->17999; 17999->18000; 18000->18001; 18001->18002; 18002->18003; 18003->18004; 18004->18005; 18005->18006; 18006->18007; 18007->18008; 18008->18009; 18009->18010; 18010->18011; 18011->18012; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time