3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 538 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 400
Associated Job Ids:
538
DAG Visualization
digraph G { subgraph clusterstage_538 { label="Stage 538"; 5653 [labelType="html" label="SQLExecutionRDD [5653]<br>run at <unknown>:0"]; 5661 [labelType="html" label="SQLExecutionRDD [5661]<br>toJavaRDD at <unknown>:0"]; 5663 [labelType="html" label="PythonRDD [5663]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster12648 { label="MicroBatchScan"; 5649 [labelType="html" label="DataSourceRDD [5649]<br>run at <unknown>:0"]; 5650 [labelType="html" label="MapPartitionsRDD [5650]<br>run at <unknown>:0"]; } subgraph cluster12647 { label="Project"; 5651 [labelType="html" label="MapPartitionsRDD [5651]<br>run at <unknown>:0"]; } subgraph cluster12643 { label="WholeStageCodegen (1)"; 5652 [labelType="html" label="MapPartitionsRDD [5652]<br>run at <unknown>:0"]; } subgraph cluster12657 { label="WholeStageCodegen (1)"; 5654 [labelType="html" label="MapPartitionsRDD [5654]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12656 { label="Filter"; 5655 [labelType="html" label="MapPartitionsRDD [5655]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12655 { label="Project"; 5656 [labelType="html" label="MapPartitionsRDD [5656]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12652 { label="WholeStageCodegen (2)"; 5657 [labelType="html" label="MapPartitionsRDD [5657]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12651 { label="Project"; 5658 [labelType="html" label="MapPartitionsRDD [5658]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12650 { label="DeserializeToObject"; 5659 [labelType="html" label="MapPartitionsRDD [5659]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12649 { label="MapPartitions"; 5660 [labelType="html" label="MapPartitionsRDD [5660]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12659 { label="mapPartitions"; 5662 [labelType="html" label="MapPartitionsRDD [5662]<br>toJavaRDD at <unknown>:0"]; } } 5649->5650; 5650->5651; 5651->5652; 5652->5653; 5653->5654; 5654->5655; 5655->5656; 5656->5657; 5657->5658; 5658->5659; 5659->5660; 5660->5661; 5661->5662; 5662->5663; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time