3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1738 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 415
Associated Job Ids:
1738
DAG Visualization
digraph G { subgraph clusterstage_1738 { label="Stage 1738"; 18253 [labelType="html" label="SQLExecutionRDD [18253]<br>run at <unknown>:0"]; 18261 [labelType="html" label="SQLExecutionRDD [18261]<br>toJavaRDD at <unknown>:0"]; 18263 [labelType="html" label="PythonRDD [18263]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster40848 { label="MicroBatchScan"; 18249 [labelType="html" label="DataSourceRDD [18249]<br>run at <unknown>:0"]; 18250 [labelType="html" label="MapPartitionsRDD [18250]<br>run at <unknown>:0"]; } subgraph cluster40847 { label="Project"; 18251 [labelType="html" label="MapPartitionsRDD [18251]<br>run at <unknown>:0"]; } subgraph cluster40843 { label="WholeStageCodegen (1)"; 18252 [labelType="html" label="MapPartitionsRDD [18252]<br>run at <unknown>:0"]; } subgraph cluster40857 { label="WholeStageCodegen (1)"; 18254 [labelType="html" label="MapPartitionsRDD [18254]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40856 { label="Filter"; 18255 [labelType="html" label="MapPartitionsRDD [18255]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40855 { label="Project"; 18256 [labelType="html" label="MapPartitionsRDD [18256]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40852 { label="WholeStageCodegen (2)"; 18257 [labelType="html" label="MapPartitionsRDD [18257]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40851 { label="Project"; 18258 [labelType="html" label="MapPartitionsRDD [18258]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40850 { label="DeserializeToObject"; 18259 [labelType="html" label="MapPartitionsRDD [18259]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40849 { label="MapPartitions"; 18260 [labelType="html" label="MapPartitionsRDD [18260]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40859 { label="mapPartitions"; 18262 [labelType="html" label="MapPartitionsRDD [18262]<br>toJavaRDD at <unknown>:0"]; } } 18249->18250; 18250->18251; 18251->18252; 18252->18253; 18253->18254; 18254->18255; 18255->18256; 18256->18257; 18257->18258; 18258->18259; 18259->18260; 18260->18261; 18261->18262; 18262->18263; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time