3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 529 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 420
Associated Job Ids:
529
DAG Visualization
digraph G { subgraph clusterstage_529 { label="Stage 529"; 5548 [labelType="html" label="SQLExecutionRDD [5548]<br>run at <unknown>:0"]; 5562 [labelType="html" label="SQLExecutionRDD [5562]<br>toJavaRDD at <unknown>:0"]; 5564 [labelType="html" label="PythonRDD [5564]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster12413 { label="MicroBatchScan"; 5544 [labelType="html" label="DataSourceRDD [5544]<br>run at <unknown>:0"]; 5545 [labelType="html" label="MapPartitionsRDD [5545]<br>run at <unknown>:0"]; } subgraph cluster12412 { label="Project"; 5546 [labelType="html" label="MapPartitionsRDD [5546]<br>run at <unknown>:0"]; } subgraph cluster12408 { label="WholeStageCodegen (1)"; 5547 [labelType="html" label="MapPartitionsRDD [5547]<br>run at <unknown>:0"]; } subgraph cluster12430 { label="WholeStageCodegen (1)"; 5555 [labelType="html" label="MapPartitionsRDD [5555]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12429 { label="Filter"; 5556 [labelType="html" label="MapPartitionsRDD [5556]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12428 { label="Project"; 5557 [labelType="html" label="MapPartitionsRDD [5557]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12425 { label="WholeStageCodegen (2)"; 5558 [labelType="html" label="MapPartitionsRDD [5558]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12424 { label="Project"; 5559 [labelType="html" label="MapPartitionsRDD [5559]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12423 { label="DeserializeToObject"; 5560 [labelType="html" label="MapPartitionsRDD [5560]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12422 { label="MapPartitions"; 5561 [labelType="html" label="MapPartitionsRDD [5561]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12432 { label="mapPartitions"; 5563 [labelType="html" label="MapPartitionsRDD [5563]<br>toJavaRDD at <unknown>:0"]; } } 5544->5545; 5545->5546; 5546->5547; 5547->5548; 5548->5555; 5555->5556; 5556->5557; 5557->5558; 5558->5559; 5559->5560; 5560->5561; 5561->5562; 5562->5563; 5563->5564; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time