3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1705 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 503
Associated Job Ids:
1706
DAG Visualization
digraph G { subgraph clusterstage_1705 { label="Stage 1705"; 17918 [labelType="html" label="SQLExecutionRDD [17918]<br>run at <unknown>:0"]; 17926 [labelType="html" label="SQLExecutionRDD [17926]<br>toJavaRDD at <unknown>:0"]; 17928 [labelType="html" label="PythonRDD [17928]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster40092 { label="MicroBatchScan"; 17914 [labelType="html" label="DataSourceRDD [17914]<br>run at <unknown>:0"]; 17915 [labelType="html" label="MapPartitionsRDD [17915]<br>run at <unknown>:0"]; } subgraph cluster40091 { label="Project"; 17916 [labelType="html" label="MapPartitionsRDD [17916]<br>run at <unknown>:0"]; } subgraph cluster40087 { label="WholeStageCodegen (1)"; 17917 [labelType="html" label="MapPartitionsRDD [17917]<br>run at <unknown>:0"]; } subgraph cluster40101 { label="WholeStageCodegen (1)"; 17919 [labelType="html" label="MapPartitionsRDD [17919]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40100 { label="Filter"; 17920 [labelType="html" label="MapPartitionsRDD [17920]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40099 { label="Project"; 17921 [labelType="html" label="MapPartitionsRDD [17921]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40096 { label="WholeStageCodegen (2)"; 17922 [labelType="html" label="MapPartitionsRDD [17922]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40095 { label="Project"; 17923 [labelType="html" label="MapPartitionsRDD [17923]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40094 { label="DeserializeToObject"; 17924 [labelType="html" label="MapPartitionsRDD [17924]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40093 { label="MapPartitions"; 17925 [labelType="html" label="MapPartitionsRDD [17925]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40103 { label="mapPartitions"; 17927 [labelType="html" label="MapPartitionsRDD [17927]<br>toJavaRDD at <unknown>:0"]; } } 17914->17915; 17915->17916; 17916->17917; 17917->17918; 17918->17919; 17919->17920; 17920->17921; 17921->17922; 17922->17923; 17923->17924; 17924->17925; 17925->17926; 17926->17927; 17927->17928; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time