3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 617 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 337
Associated Job Ids:
618
DAG Visualization
digraph G { subgraph clusterstage_617 { label="Stage 617"; 6494 [labelType="html" label="SQLExecutionRDD [6494]<br>run at <unknown>:0"]; 6502 [labelType="html" label="SQLExecutionRDD [6502]<br>toJavaRDD at <unknown>:0"]; 6504 [labelType="html" label="PythonRDD [6504]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14524 { label="MicroBatchScan"; 6490 [labelType="html" label="DataSourceRDD [6490]<br>run at <unknown>:0"]; 6491 [labelType="html" label="MapPartitionsRDD [6491]<br>run at <unknown>:0"]; } subgraph cluster14523 { label="Project"; 6492 [labelType="html" label="MapPartitionsRDD [6492]<br>run at <unknown>:0"]; } subgraph cluster14519 { label="WholeStageCodegen (1)"; 6493 [labelType="html" label="MapPartitionsRDD [6493]<br>run at <unknown>:0"]; } subgraph cluster14533 { label="WholeStageCodegen (1)"; 6495 [labelType="html" label="MapPartitionsRDD [6495]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14532 { label="Filter"; 6496 [labelType="html" label="MapPartitionsRDD [6496]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14531 { label="Project"; 6497 [labelType="html" label="MapPartitionsRDD [6497]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14528 { label="WholeStageCodegen (2)"; 6498 [labelType="html" label="MapPartitionsRDD [6498]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14527 { label="Project"; 6499 [labelType="html" label="MapPartitionsRDD [6499]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14526 { label="DeserializeToObject"; 6500 [labelType="html" label="MapPartitionsRDD [6500]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14525 { label="MapPartitions"; 6501 [labelType="html" label="MapPartitionsRDD [6501]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14535 { label="mapPartitions"; 6503 [labelType="html" label="MapPartitionsRDD [6503]<br>toJavaRDD at <unknown>:0"]; } } 6490->6491; 6491->6492; 6492->6493; 6493->6494; 6494->6495; 6495->6496; 6496->6497; 6497->6498; 6498->6499; 6499->6500; 6500->6501; 6501->6502; 6502->6503; 6503->6504; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time