3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1914 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 453
Associated Job Ids:
1914
DAG Visualization
digraph G { subgraph clusterstage_1914 { label="Stage 1914"; 20101 [labelType="html" label="SQLExecutionRDD [20101]<br>run at <unknown>:0"]; 20109 [labelType="html" label="SQLExecutionRDD [20109]<br>toJavaRDD at <unknown>:0"]; 20111 [labelType="html" label="PythonRDD [20111]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster44984 { label="MicroBatchScan"; 20097 [labelType="html" label="DataSourceRDD [20097]<br>run at <unknown>:0"]; 20098 [labelType="html" label="MapPartitionsRDD [20098]<br>run at <unknown>:0"]; } subgraph cluster44983 { label="Project"; 20099 [labelType="html" label="MapPartitionsRDD [20099]<br>run at <unknown>:0"]; } subgraph cluster44979 { label="WholeStageCodegen (1)"; 20100 [labelType="html" label="MapPartitionsRDD [20100]<br>run at <unknown>:0"]; } subgraph cluster44993 { label="WholeStageCodegen (1)"; 20102 [labelType="html" label="MapPartitionsRDD [20102]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44992 { label="Filter"; 20103 [labelType="html" label="MapPartitionsRDD [20103]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44991 { label="Project"; 20104 [labelType="html" label="MapPartitionsRDD [20104]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44988 { label="WholeStageCodegen (2)"; 20105 [labelType="html" label="MapPartitionsRDD [20105]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44987 { label="Project"; 20106 [labelType="html" label="MapPartitionsRDD [20106]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44986 { label="DeserializeToObject"; 20107 [labelType="html" label="MapPartitionsRDD [20107]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44985 { label="MapPartitions"; 20108 [labelType="html" label="MapPartitionsRDD [20108]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44995 { label="mapPartitions"; 20110 [labelType="html" label="MapPartitionsRDD [20110]<br>toJavaRDD at <unknown>:0"]; } } 20097->20098; 20098->20099; 20099->20100; 20100->20101; 20101->20102; 20102->20103; 20103->20104; 20104->20105; 20105->20106; 20106->20107; 20107->20108; 20108->20109; 20109->20110; 20110->20111; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time