3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1137 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 472
Associated Job Ids:
1138
DAG Visualization
digraph G { subgraph clusterstage_1137 { label="Stage 1137"; 11954 [labelType="html" label="SQLExecutionRDD [11954]<br>run at <unknown>:0"]; 11962 [labelType="html" label="SQLExecutionRDD [11962]<br>toJavaRDD at <unknown>:0"]; 11964 [labelType="html" label="PythonRDD [11964]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26744 { label="MicroBatchScan"; 11950 [labelType="html" label="DataSourceRDD [11950]<br>run at <unknown>:0"]; 11951 [labelType="html" label="MapPartitionsRDD [11951]<br>run at <unknown>:0"]; } subgraph cluster26743 { label="Project"; 11952 [labelType="html" label="MapPartitionsRDD [11952]<br>run at <unknown>:0"]; } subgraph cluster26739 { label="WholeStageCodegen (1)"; 11953 [labelType="html" label="MapPartitionsRDD [11953]<br>run at <unknown>:0"]; } subgraph cluster26753 { label="WholeStageCodegen (1)"; 11955 [labelType="html" label="MapPartitionsRDD [11955]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26752 { label="Filter"; 11956 [labelType="html" label="MapPartitionsRDD [11956]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26751 { label="Project"; 11957 [labelType="html" label="MapPartitionsRDD [11957]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26748 { label="WholeStageCodegen (2)"; 11958 [labelType="html" label="MapPartitionsRDD [11958]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26747 { label="Project"; 11959 [labelType="html" label="MapPartitionsRDD [11959]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26746 { label="DeserializeToObject"; 11960 [labelType="html" label="MapPartitionsRDD [11960]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26745 { label="MapPartitions"; 11961 [labelType="html" label="MapPartitionsRDD [11961]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26755 { label="mapPartitions"; 11963 [labelType="html" label="MapPartitionsRDD [11963]<br>toJavaRDD at <unknown>:0"]; } } 11950->11951; 11951->11952; 11952->11953; 11953->11954; 11954->11955; 11955->11956; 11956->11957; 11957->11958; 11958->11959; 11959->11960; 11960->11961; 11961->11962; 11962->11963; 11963->11964; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time