3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1423 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 406
Associated Job Ids:
1424
DAG Visualization
digraph G { subgraph clusterstage_1423 { label="Stage 1423"; 14957 [labelType="html" label="SQLExecutionRDD [14957]<br>run at <unknown>:0"]; 14965 [labelType="html" label="SQLExecutionRDD [14965]<br>toJavaRDD at <unknown>:0"]; 14973 [labelType="html" label="PythonRDD [14973]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster33465 { label="MicroBatchScan"; 14953 [labelType="html" label="DataSourceRDD [14953]<br>run at <unknown>:0"]; 14954 [labelType="html" label="MapPartitionsRDD [14954]<br>run at <unknown>:0"]; } subgraph cluster33464 { label="Project"; 14955 [labelType="html" label="MapPartitionsRDD [14955]<br>run at <unknown>:0"]; } subgraph cluster33460 { label="WholeStageCodegen (1)"; 14956 [labelType="html" label="MapPartitionsRDD [14956]<br>run at <unknown>:0"]; } subgraph cluster33474 { label="WholeStageCodegen (1)"; 14958 [labelType="html" label="MapPartitionsRDD [14958]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33473 { label="Filter"; 14959 [labelType="html" label="MapPartitionsRDD [14959]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33472 { label="Project"; 14960 [labelType="html" label="MapPartitionsRDD [14960]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33469 { label="WholeStageCodegen (2)"; 14961 [labelType="html" label="MapPartitionsRDD [14961]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33468 { label="Project"; 14962 [labelType="html" label="MapPartitionsRDD [14962]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33467 { label="DeserializeToObject"; 14963 [labelType="html" label="MapPartitionsRDD [14963]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33466 { label="MapPartitions"; 14964 [labelType="html" label="MapPartitionsRDD [14964]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33476 { label="mapPartitions"; 14966 [labelType="html" label="MapPartitionsRDD [14966]<br>toJavaRDD at <unknown>:0"]; } } 14953->14954; 14954->14955; 14955->14956; 14956->14957; 14957->14958; 14958->14959; 14959->14960; 14960->14961; 14961->14962; 14962->14963; 14963->14964; 14964->14965; 14965->14966; 14966->14973; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time