3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1844 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 429
Associated Job Ids:
1844
DAG Visualization
digraph G { subgraph clusterstage_1844 { label="Stage 1844"; 19366 [labelType="html" label="SQLExecutionRDD [19366]<br>run at <unknown>:0"]; 19374 [labelType="html" label="SQLExecutionRDD [19374]<br>toJavaRDD at <unknown>:0"]; 19376 [labelType="html" label="PythonRDD [19376]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster43339 { label="MicroBatchScan"; 19362 [labelType="html" label="DataSourceRDD [19362]<br>run at <unknown>:0"]; 19363 [labelType="html" label="MapPartitionsRDD [19363]<br>run at <unknown>:0"]; } subgraph cluster43338 { label="Project"; 19364 [labelType="html" label="MapPartitionsRDD [19364]<br>run at <unknown>:0"]; } subgraph cluster43334 { label="WholeStageCodegen (1)"; 19365 [labelType="html" label="MapPartitionsRDD [19365]<br>run at <unknown>:0"]; } subgraph cluster43348 { label="WholeStageCodegen (1)"; 19367 [labelType="html" label="MapPartitionsRDD [19367]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43347 { label="Filter"; 19368 [labelType="html" label="MapPartitionsRDD [19368]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43346 { label="Project"; 19369 [labelType="html" label="MapPartitionsRDD [19369]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43343 { label="WholeStageCodegen (2)"; 19370 [labelType="html" label="MapPartitionsRDD [19370]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43342 { label="Project"; 19371 [labelType="html" label="MapPartitionsRDD [19371]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43341 { label="DeserializeToObject"; 19372 [labelType="html" label="MapPartitionsRDD [19372]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43340 { label="MapPartitions"; 19373 [labelType="html" label="MapPartitionsRDD [19373]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43350 { label="mapPartitions"; 19375 [labelType="html" label="MapPartitionsRDD [19375]<br>toJavaRDD at <unknown>:0"]; } } 19362->19363; 19363->19364; 19364->19365; 19365->19366; 19366->19367; 19367->19368; 19368->19369; 19369->19370; 19370->19371; 19371->19372; 19372->19373; 19373->19374; 19374->19375; 19375->19376; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time