3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1662 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 511
Associated Job Ids:
1663
DAG Visualization
digraph G { subgraph clusterstage_1662 { label="Stage 1662"; 17456 [labelType="html" label="SQLExecutionRDD [17456]<br>run at <unknown>:0"]; 17470 [labelType="html" label="SQLExecutionRDD [17470]<br>toJavaRDD at <unknown>:0"]; 17472 [labelType="html" label="PythonRDD [17472]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster39058 { label="MicroBatchScan"; 17452 [labelType="html" label="DataSourceRDD [17452]<br>run at <unknown>:0"]; 17453 [labelType="html" label="MapPartitionsRDD [17453]<br>run at <unknown>:0"]; } subgraph cluster39057 { label="Project"; 17454 [labelType="html" label="MapPartitionsRDD [17454]<br>run at <unknown>:0"]; } subgraph cluster39053 { label="WholeStageCodegen (1)"; 17455 [labelType="html" label="MapPartitionsRDD [17455]<br>run at <unknown>:0"]; } subgraph cluster39075 { label="WholeStageCodegen (1)"; 17463 [labelType="html" label="MapPartitionsRDD [17463]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39074 { label="Filter"; 17464 [labelType="html" label="MapPartitionsRDD [17464]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39073 { label="Project"; 17465 [labelType="html" label="MapPartitionsRDD [17465]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39070 { label="WholeStageCodegen (2)"; 17466 [labelType="html" label="MapPartitionsRDD [17466]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39069 { label="Project"; 17467 [labelType="html" label="MapPartitionsRDD [17467]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39068 { label="DeserializeToObject"; 17468 [labelType="html" label="MapPartitionsRDD [17468]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39067 { label="MapPartitions"; 17469 [labelType="html" label="MapPartitionsRDD [17469]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39077 { label="mapPartitions"; 17471 [labelType="html" label="MapPartitionsRDD [17471]<br>toJavaRDD at <unknown>:0"]; } } 17452->17453; 17453->17454; 17454->17455; 17455->17456; 17456->17463; 17463->17464; 17464->17465; 17465->17466; 17466->17467; 17467->17468; 17468->17469; 17469->17470; 17470->17471; 17471->17472; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time