3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1711 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 386
Associated Job Ids:
1712
DAG Visualization
digraph G { subgraph clusterstage_1711 { label="Stage 1711"; 17981 [labelType="html" label="SQLExecutionRDD [17981]<br>run at <unknown>:0"]; 17989 [labelType="html" label="SQLExecutionRDD [17989]<br>toJavaRDD at <unknown>:0"]; 17991 [labelType="html" label="PythonRDD [17991]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster40233 { label="MicroBatchScan"; 17977 [labelType="html" label="DataSourceRDD [17977]<br>run at <unknown>:0"]; 17978 [labelType="html" label="MapPartitionsRDD [17978]<br>run at <unknown>:0"]; } subgraph cluster40232 { label="Project"; 17979 [labelType="html" label="MapPartitionsRDD [17979]<br>run at <unknown>:0"]; } subgraph cluster40228 { label="WholeStageCodegen (1)"; 17980 [labelType="html" label="MapPartitionsRDD [17980]<br>run at <unknown>:0"]; } subgraph cluster40242 { label="WholeStageCodegen (1)"; 17982 [labelType="html" label="MapPartitionsRDD [17982]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40241 { label="Filter"; 17983 [labelType="html" label="MapPartitionsRDD [17983]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40240 { label="Project"; 17984 [labelType="html" label="MapPartitionsRDD [17984]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40237 { label="WholeStageCodegen (2)"; 17985 [labelType="html" label="MapPartitionsRDD [17985]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40236 { label="Project"; 17986 [labelType="html" label="MapPartitionsRDD [17986]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40235 { label="DeserializeToObject"; 17987 [labelType="html" label="MapPartitionsRDD [17987]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40234 { label="MapPartitions"; 17988 [labelType="html" label="MapPartitionsRDD [17988]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40244 { label="mapPartitions"; 17990 [labelType="html" label="MapPartitionsRDD [17990]<br>toJavaRDD at <unknown>:0"]; } } 17977->17978; 17978->17979; 17979->17980; 17980->17981; 17981->17982; 17982->17983; 17983->17984; 17984->17985; 17985->17986; 17986->17987; 17987->17988; 17988->17989; 17989->17990; 17990->17991; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time