3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2035 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 418
Associated Job Ids:
2036
DAG Visualization
digraph G { subgraph clusterstage_2035 { label="Stage 2035"; 21383 [labelType="html" label="SQLExecutionRDD [21383]<br>run at <unknown>:0"]; 21391 [labelType="html" label="SQLExecutionRDD [21391]<br>toJavaRDD at <unknown>:0"]; 21393 [labelType="html" label="PythonRDD [21393]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47847 { label="MicroBatchScan"; 21379 [labelType="html" label="DataSourceRDD [21379]<br>run at <unknown>:0"]; 21380 [labelType="html" label="MapPartitionsRDD [21380]<br>run at <unknown>:0"]; } subgraph cluster47846 { label="Project"; 21381 [labelType="html" label="MapPartitionsRDD [21381]<br>run at <unknown>:0"]; } subgraph cluster47842 { label="WholeStageCodegen (1)"; 21382 [labelType="html" label="MapPartitionsRDD [21382]<br>run at <unknown>:0"]; } subgraph cluster47856 { label="WholeStageCodegen (1)"; 21384 [labelType="html" label="MapPartitionsRDD [21384]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47855 { label="Filter"; 21385 [labelType="html" label="MapPartitionsRDD [21385]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47854 { label="Project"; 21386 [labelType="html" label="MapPartitionsRDD [21386]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47851 { label="WholeStageCodegen (2)"; 21387 [labelType="html" label="MapPartitionsRDD [21387]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47850 { label="Project"; 21388 [labelType="html" label="MapPartitionsRDD [21388]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47849 { label="DeserializeToObject"; 21389 [labelType="html" label="MapPartitionsRDD [21389]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47848 { label="MapPartitions"; 21390 [labelType="html" label="MapPartitionsRDD [21390]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47858 { label="mapPartitions"; 21392 [labelType="html" label="MapPartitionsRDD [21392]<br>toJavaRDD at <unknown>:0"]; } } 21379->21380; 21380->21381; 21381->21382; 21382->21383; 21383->21384; 21384->21385; 21385->21386; 21386->21387; 21387->21388; 21388->21389; 21389->21390; 21390->21391; 21391->21392; 21392->21393; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time