3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 662 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 460
Associated Job Ids:
663
DAG Visualization
digraph G { subgraph clusterstage_662 { label="Stage 662"; 6962 [labelType="html" label="SQLExecutionRDD [6962]<br>run at <unknown>:0"]; 6970 [labelType="html" label="SQLExecutionRDD [6970]<br>toJavaRDD at <unknown>:0"]; 6972 [labelType="html" label="PythonRDD [6972]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster15566 { label="MicroBatchScan"; 6958 [labelType="html" label="DataSourceRDD [6958]<br>run at <unknown>:0"]; 6959 [labelType="html" label="MapPartitionsRDD [6959]<br>run at <unknown>:0"]; } subgraph cluster15565 { label="Project"; 6960 [labelType="html" label="MapPartitionsRDD [6960]<br>run at <unknown>:0"]; } subgraph cluster15561 { label="WholeStageCodegen (1)"; 6961 [labelType="html" label="MapPartitionsRDD [6961]<br>run at <unknown>:0"]; } subgraph cluster15575 { label="WholeStageCodegen (1)"; 6963 [labelType="html" label="MapPartitionsRDD [6963]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15574 { label="Filter"; 6964 [labelType="html" label="MapPartitionsRDD [6964]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15573 { label="Project"; 6965 [labelType="html" label="MapPartitionsRDD [6965]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15570 { label="WholeStageCodegen (2)"; 6966 [labelType="html" label="MapPartitionsRDD [6966]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15569 { label="Project"; 6967 [labelType="html" label="MapPartitionsRDD [6967]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15568 { label="DeserializeToObject"; 6968 [labelType="html" label="MapPartitionsRDD [6968]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15567 { label="MapPartitions"; 6969 [labelType="html" label="MapPartitionsRDD [6969]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15577 { label="mapPartitions"; 6971 [labelType="html" label="MapPartitionsRDD [6971]<br>toJavaRDD at <unknown>:0"]; } } 6958->6959; 6959->6960; 6960->6961; 6961->6962; 6962->6963; 6963->6964; 6964->6965; 6965->6966; 6966->6967; 6967->6968; 6968->6969; 6969->6970; 6970->6971; 6971->6972; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time