3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1295 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 442
Associated Job Ids:
1295
DAG Visualization
digraph G { subgraph clusterstage_1295 { label="Stage 1295"; 13597 [labelType="html" label="SQLExecutionRDD [13597]<br>run at <unknown>:0"]; 13605 [labelType="html" label="SQLExecutionRDD [13605]<br>toJavaRDD at <unknown>:0"]; 13607 [labelType="html" label="PythonRDD [13607]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30422 { label="MicroBatchScan"; 13593 [labelType="html" label="DataSourceRDD [13593]<br>run at <unknown>:0"]; 13594 [labelType="html" label="MapPartitionsRDD [13594]<br>run at <unknown>:0"]; } subgraph cluster30421 { label="Project"; 13595 [labelType="html" label="MapPartitionsRDD [13595]<br>run at <unknown>:0"]; } subgraph cluster30417 { label="WholeStageCodegen (1)"; 13596 [labelType="html" label="MapPartitionsRDD [13596]<br>run at <unknown>:0"]; } subgraph cluster30431 { label="WholeStageCodegen (1)"; 13598 [labelType="html" label="MapPartitionsRDD [13598]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30430 { label="Filter"; 13599 [labelType="html" label="MapPartitionsRDD [13599]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30429 { label="Project"; 13600 [labelType="html" label="MapPartitionsRDD [13600]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30426 { label="WholeStageCodegen (2)"; 13601 [labelType="html" label="MapPartitionsRDD [13601]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30425 { label="Project"; 13602 [labelType="html" label="MapPartitionsRDD [13602]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30424 { label="DeserializeToObject"; 13603 [labelType="html" label="MapPartitionsRDD [13603]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30423 { label="MapPartitions"; 13604 [labelType="html" label="MapPartitionsRDD [13604]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30433 { label="mapPartitions"; 13606 [labelType="html" label="MapPartitionsRDD [13606]<br>toJavaRDD at <unknown>:0"]; } } 13593->13594; 13594->13595; 13595->13596; 13596->13597; 13597->13598; 13598->13599; 13599->13600; 13600->13601; 13601->13602; 13602->13603; 13603->13604; 13604->13605; 13605->13606; 13606->13607; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time