3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 948 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 420
Associated Job Ids:
948
DAG Visualization
digraph G { subgraph clusterstage_948 { label="Stage 948"; 9958 [labelType="html" label="SQLExecutionRDD [9958]<br>run at <unknown>:0"]; 9966 [labelType="html" label="SQLExecutionRDD [9966]<br>toJavaRDD at <unknown>:0"]; 9968 [labelType="html" label="PythonRDD [9968]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster22283 { label="MicroBatchScan"; 9954 [labelType="html" label="DataSourceRDD [9954]<br>run at <unknown>:0"]; 9955 [labelType="html" label="MapPartitionsRDD [9955]<br>run at <unknown>:0"]; } subgraph cluster22282 { label="Project"; 9956 [labelType="html" label="MapPartitionsRDD [9956]<br>run at <unknown>:0"]; } subgraph cluster22278 { label="WholeStageCodegen (1)"; 9957 [labelType="html" label="MapPartitionsRDD [9957]<br>run at <unknown>:0"]; } subgraph cluster22292 { label="WholeStageCodegen (1)"; 9959 [labelType="html" label="MapPartitionsRDD [9959]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22291 { label="Filter"; 9960 [labelType="html" label="MapPartitionsRDD [9960]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22290 { label="Project"; 9961 [labelType="html" label="MapPartitionsRDD [9961]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22287 { label="WholeStageCodegen (2)"; 9962 [labelType="html" label="MapPartitionsRDD [9962]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22286 { label="Project"; 9963 [labelType="html" label="MapPartitionsRDD [9963]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22285 { label="DeserializeToObject"; 9964 [labelType="html" label="MapPartitionsRDD [9964]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22284 { label="MapPartitions"; 9965 [labelType="html" label="MapPartitionsRDD [9965]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22294 { label="mapPartitions"; 9967 [labelType="html" label="MapPartitionsRDD [9967]<br>toJavaRDD at <unknown>:0"]; } } 9954->9955; 9955->9956; 9956->9957; 9957->9958; 9958->9959; 9959->9960; 9960->9961; 9961->9962; 9962->9963; 9963->9964; 9964->9965; 9965->9966; 9966->9967; 9967->9968; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time