3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1805 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 347
Associated Job Ids:
1805
DAG Visualization
digraph G { subgraph clusterstage_1805 { label="Stage 1805"; 18952 [labelType="html" label="SQLExecutionRDD [18952]<br>run at <unknown>:0"]; 18960 [labelType="html" label="SQLExecutionRDD [18960]<br>toJavaRDD at <unknown>:0"]; 18962 [labelType="html" label="PythonRDD [18962]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster42407 { label="MicroBatchScan"; 18948 [labelType="html" label="DataSourceRDD [18948]<br>run at <unknown>:0"]; 18949 [labelType="html" label="MapPartitionsRDD [18949]<br>run at <unknown>:0"]; } subgraph cluster42406 { label="Project"; 18950 [labelType="html" label="MapPartitionsRDD [18950]<br>run at <unknown>:0"]; } subgraph cluster42402 { label="WholeStageCodegen (1)"; 18951 [labelType="html" label="MapPartitionsRDD [18951]<br>run at <unknown>:0"]; } subgraph cluster42416 { label="WholeStageCodegen (1)"; 18953 [labelType="html" label="MapPartitionsRDD [18953]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42415 { label="Filter"; 18954 [labelType="html" label="MapPartitionsRDD [18954]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42414 { label="Project"; 18955 [labelType="html" label="MapPartitionsRDD [18955]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42411 { label="WholeStageCodegen (2)"; 18956 [labelType="html" label="MapPartitionsRDD [18956]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42410 { label="Project"; 18957 [labelType="html" label="MapPartitionsRDD [18957]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42409 { label="DeserializeToObject"; 18958 [labelType="html" label="MapPartitionsRDD [18958]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42408 { label="MapPartitions"; 18959 [labelType="html" label="MapPartitionsRDD [18959]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster42418 { label="mapPartitions"; 18961 [labelType="html" label="MapPartitionsRDD [18961]<br>toJavaRDD at <unknown>:0"]; } } 18948->18949; 18949->18950; 18950->18951; 18951->18952; 18952->18953; 18953->18954; 18954->18955; 18955->18956; 18956->18957; 18957->18958; 18958->18959; 18959->18960; 18960->18961; 18961->18962; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time