3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1139 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 389
Associated Job Ids:
1140
DAG Visualization
digraph G { subgraph clusterstage_1139 { label="Stage 1139"; 11975 [labelType="html" label="SQLExecutionRDD [11975]<br>run at <unknown>:0"]; 11983 [labelType="html" label="SQLExecutionRDD [11983]<br>toJavaRDD at <unknown>:0"]; 11985 [labelType="html" label="PythonRDD [11985]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26791 { label="MicroBatchScan"; 11971 [labelType="html" label="DataSourceRDD [11971]<br>run at <unknown>:0"]; 11972 [labelType="html" label="MapPartitionsRDD [11972]<br>run at <unknown>:0"]; } subgraph cluster26790 { label="Project"; 11973 [labelType="html" label="MapPartitionsRDD [11973]<br>run at <unknown>:0"]; } subgraph cluster26786 { label="WholeStageCodegen (1)"; 11974 [labelType="html" label="MapPartitionsRDD [11974]<br>run at <unknown>:0"]; } subgraph cluster26800 { label="WholeStageCodegen (1)"; 11976 [labelType="html" label="MapPartitionsRDD [11976]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26799 { label="Filter"; 11977 [labelType="html" label="MapPartitionsRDD [11977]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26798 { label="Project"; 11978 [labelType="html" label="MapPartitionsRDD [11978]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26795 { label="WholeStageCodegen (2)"; 11979 [labelType="html" label="MapPartitionsRDD [11979]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26794 { label="Project"; 11980 [labelType="html" label="MapPartitionsRDD [11980]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26793 { label="DeserializeToObject"; 11981 [labelType="html" label="MapPartitionsRDD [11981]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26792 { label="MapPartitions"; 11982 [labelType="html" label="MapPartitionsRDD [11982]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26802 { label="mapPartitions"; 11984 [labelType="html" label="MapPartitionsRDD [11984]<br>toJavaRDD at <unknown>:0"]; } } 11971->11972; 11972->11973; 11973->11974; 11974->11975; 11975->11976; 11976->11977; 11977->11978; 11978->11979; 11979->11980; 11980->11981; 11981->11982; 11982->11983; 11983->11984; 11984->11985; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time