3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 472 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 477
Associated Job Ids:
472
DAG Visualization
digraph G { subgraph clusterstage_472 { label="Stage 472"; 4960 [labelType="html" label="SQLExecutionRDD [4960]<br>run at <unknown>:0"]; 4968 [labelType="html" label="SQLExecutionRDD [4968]<br>toJavaRDD at <unknown>:0"]; 4970 [labelType="html" label="PythonRDD [4970]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11097 { label="MicroBatchScan"; 4956 [labelType="html" label="DataSourceRDD [4956]<br>run at <unknown>:0"]; 4957 [labelType="html" label="MapPartitionsRDD [4957]<br>run at <unknown>:0"]; } subgraph cluster11096 { label="Project"; 4958 [labelType="html" label="MapPartitionsRDD [4958]<br>run at <unknown>:0"]; } subgraph cluster11092 { label="WholeStageCodegen (1)"; 4959 [labelType="html" label="MapPartitionsRDD [4959]<br>run at <unknown>:0"]; } subgraph cluster11106 { label="WholeStageCodegen (1)"; 4961 [labelType="html" label="MapPartitionsRDD [4961]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11105 { label="Filter"; 4962 [labelType="html" label="MapPartitionsRDD [4962]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11104 { label="Project"; 4963 [labelType="html" label="MapPartitionsRDD [4963]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11101 { label="WholeStageCodegen (2)"; 4964 [labelType="html" label="MapPartitionsRDD [4964]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11100 { label="Project"; 4965 [labelType="html" label="MapPartitionsRDD [4965]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11099 { label="DeserializeToObject"; 4966 [labelType="html" label="MapPartitionsRDD [4966]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11098 { label="MapPartitions"; 4967 [labelType="html" label="MapPartitionsRDD [4967]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11108 { label="mapPartitions"; 4969 [labelType="html" label="MapPartitionsRDD [4969]<br>toJavaRDD at <unknown>:0"]; } } 4956->4957; 4957->4958; 4958->4959; 4959->4960; 4960->4961; 4961->4962; 4962->4963; 4963->4964; 4964->4965; 4965->4966; 4966->4967; 4967->4968; 4968->4969; 4969->4970; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time