3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1878 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 477
Associated Job Ids:
1878
DAG Visualization
digraph G { subgraph clusterstage_1878 { label="Stage 1878"; 19723 [labelType="html" label="SQLExecutionRDD [19723]<br>run at <unknown>:0"]; 19731 [labelType="html" label="SQLExecutionRDD [19731]<br>toJavaRDD at <unknown>:0"]; 19733 [labelType="html" label="PythonRDD [19733]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster44138 { label="MicroBatchScan"; 19719 [labelType="html" label="DataSourceRDD [19719]<br>run at <unknown>:0"]; 19720 [labelType="html" label="MapPartitionsRDD [19720]<br>run at <unknown>:0"]; } subgraph cluster44137 { label="Project"; 19721 [labelType="html" label="MapPartitionsRDD [19721]<br>run at <unknown>:0"]; } subgraph cluster44133 { label="WholeStageCodegen (1)"; 19722 [labelType="html" label="MapPartitionsRDD [19722]<br>run at <unknown>:0"]; } subgraph cluster44147 { label="WholeStageCodegen (1)"; 19724 [labelType="html" label="MapPartitionsRDD [19724]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44146 { label="Filter"; 19725 [labelType="html" label="MapPartitionsRDD [19725]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44145 { label="Project"; 19726 [labelType="html" label="MapPartitionsRDD [19726]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44142 { label="WholeStageCodegen (2)"; 19727 [labelType="html" label="MapPartitionsRDD [19727]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44141 { label="Project"; 19728 [labelType="html" label="MapPartitionsRDD [19728]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44140 { label="DeserializeToObject"; 19729 [labelType="html" label="MapPartitionsRDD [19729]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44139 { label="MapPartitions"; 19730 [labelType="html" label="MapPartitionsRDD [19730]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44149 { label="mapPartitions"; 19732 [labelType="html" label="MapPartitionsRDD [19732]<br>toJavaRDD at <unknown>:0"]; } } 19719->19720; 19720->19721; 19721->19722; 19722->19723; 19723->19724; 19724->19725; 19725->19726; 19726->19727; 19727->19728; 19728->19729; 19729->19730; 19730->19731; 19731->19732; 19732->19733; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time