3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 612 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 455
Associated Job Ids:
612
DAG Visualization
digraph G { subgraph clusterstage_612 { label="Stage 612"; 6430 [labelType="html" label="SQLExecutionRDD [6430]<br>run at <unknown>:0"]; 6438 [labelType="html" label="SQLExecutionRDD [6438]<br>toJavaRDD at <unknown>:0"]; 6440 [labelType="html" label="PythonRDD [6440]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14387 { label="MicroBatchScan"; 6426 [labelType="html" label="DataSourceRDD [6426]<br>run at <unknown>:0"]; 6427 [labelType="html" label="MapPartitionsRDD [6427]<br>run at <unknown>:0"]; } subgraph cluster14386 { label="Project"; 6428 [labelType="html" label="MapPartitionsRDD [6428]<br>run at <unknown>:0"]; } subgraph cluster14382 { label="WholeStageCodegen (1)"; 6429 [labelType="html" label="MapPartitionsRDD [6429]<br>run at <unknown>:0"]; } subgraph cluster14396 { label="WholeStageCodegen (1)"; 6431 [labelType="html" label="MapPartitionsRDD [6431]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14395 { label="Filter"; 6432 [labelType="html" label="MapPartitionsRDD [6432]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14394 { label="Project"; 6433 [labelType="html" label="MapPartitionsRDD [6433]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14391 { label="WholeStageCodegen (2)"; 6434 [labelType="html" label="MapPartitionsRDD [6434]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14390 { label="Project"; 6435 [labelType="html" label="MapPartitionsRDD [6435]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14389 { label="DeserializeToObject"; 6436 [labelType="html" label="MapPartitionsRDD [6436]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14388 { label="MapPartitions"; 6437 [labelType="html" label="MapPartitionsRDD [6437]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14398 { label="mapPartitions"; 6439 [labelType="html" label="MapPartitionsRDD [6439]<br>toJavaRDD at <unknown>:0"]; } } 6426->6427; 6427->6428; 6428->6429; 6429->6430; 6430->6431; 6431->6432; 6432->6433; 6433->6434; 6434->6435; 6435->6436; 6436->6437; 6437->6438; 6438->6439; 6439->6440; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time