3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1716 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 497
Associated Job Ids:
1717
DAG Visualization
digraph G { subgraph clusterstage_1716 { label="Stage 1716"; 18023 [labelType="html" label="SQLExecutionRDD [18023]<br>run at <unknown>:0"]; 18037 [labelType="html" label="SQLExecutionRDD [18037]<br>toJavaRDD at <unknown>:0"]; 18039 [labelType="html" label="PythonRDD [18039]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster40327 { label="MicroBatchScan"; 18019 [labelType="html" label="DataSourceRDD [18019]<br>run at <unknown>:0"]; 18020 [labelType="html" label="MapPartitionsRDD [18020]<br>run at <unknown>:0"]; } subgraph cluster40326 { label="Project"; 18021 [labelType="html" label="MapPartitionsRDD [18021]<br>run at <unknown>:0"]; } subgraph cluster40322 { label="WholeStageCodegen (1)"; 18022 [labelType="html" label="MapPartitionsRDD [18022]<br>run at <unknown>:0"]; } subgraph cluster40344 { label="WholeStageCodegen (1)"; 18030 [labelType="html" label="MapPartitionsRDD [18030]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40343 { label="Filter"; 18031 [labelType="html" label="MapPartitionsRDD [18031]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40342 { label="Project"; 18032 [labelType="html" label="MapPartitionsRDD [18032]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40339 { label="WholeStageCodegen (2)"; 18033 [labelType="html" label="MapPartitionsRDD [18033]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40338 { label="Project"; 18034 [labelType="html" label="MapPartitionsRDD [18034]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40337 { label="DeserializeToObject"; 18035 [labelType="html" label="MapPartitionsRDD [18035]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40336 { label="MapPartitions"; 18036 [labelType="html" label="MapPartitionsRDD [18036]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40346 { label="mapPartitions"; 18038 [labelType="html" label="MapPartitionsRDD [18038]<br>toJavaRDD at <unknown>:0"]; } } 18019->18020; 18020->18021; 18021->18022; 18022->18023; 18023->18030; 18030->18031; 18031->18032; 18032->18033; 18033->18034; 18034->18035; 18035->18036; 18036->18037; 18037->18038; 18038->18039; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time