3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1675 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 479
Associated Job Ids:
1676
DAG Visualization
digraph G { subgraph clusterstage_1675 { label="Stage 1675"; 17603 [labelType="html" label="SQLExecutionRDD [17603]<br>run at <unknown>:0"]; 17611 [labelType="html" label="SQLExecutionRDD [17611]<br>toJavaRDD at <unknown>:0"]; 17613 [labelType="html" label="PythonRDD [17613]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster39387 { label="MicroBatchScan"; 17599 [labelType="html" label="DataSourceRDD [17599]<br>run at <unknown>:0"]; 17600 [labelType="html" label="MapPartitionsRDD [17600]<br>run at <unknown>:0"]; } subgraph cluster39386 { label="Project"; 17601 [labelType="html" label="MapPartitionsRDD [17601]<br>run at <unknown>:0"]; } subgraph cluster39382 { label="WholeStageCodegen (1)"; 17602 [labelType="html" label="MapPartitionsRDD [17602]<br>run at <unknown>:0"]; } subgraph cluster39396 { label="WholeStageCodegen (1)"; 17604 [labelType="html" label="MapPartitionsRDD [17604]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39395 { label="Filter"; 17605 [labelType="html" label="MapPartitionsRDD [17605]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39394 { label="Project"; 17606 [labelType="html" label="MapPartitionsRDD [17606]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39391 { label="WholeStageCodegen (2)"; 17607 [labelType="html" label="MapPartitionsRDD [17607]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39390 { label="Project"; 17608 [labelType="html" label="MapPartitionsRDD [17608]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39389 { label="DeserializeToObject"; 17609 [labelType="html" label="MapPartitionsRDD [17609]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39388 { label="MapPartitions"; 17610 [labelType="html" label="MapPartitionsRDD [17610]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39398 { label="mapPartitions"; 17612 [labelType="html" label="MapPartitionsRDD [17612]<br>toJavaRDD at <unknown>:0"]; } } 17599->17600; 17600->17601; 17601->17602; 17602->17603; 17603->17604; 17604->17605; 17605->17606; 17606->17607; 17607->17608; 17608->17609; 17609->17610; 17610->17611; 17611->17612; 17612->17613; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time