3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 918 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 392
Associated Job Ids:
919
DAG Visualization
digraph G { subgraph clusterstage_918 { label="Stage 918"; 9644 [labelType="html" label="SQLExecutionRDD [9644]<br>run at <unknown>:0"]; 9658 [labelType="html" label="SQLExecutionRDD [9658]<br>toJavaRDD at <unknown>:0"]; 9660 [labelType="html" label="PythonRDD [9660]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster21574 { label="MicroBatchScan"; 9640 [labelType="html" label="DataSourceRDD [9640]<br>run at <unknown>:0"]; 9641 [labelType="html" label="MapPartitionsRDD [9641]<br>run at <unknown>:0"]; } subgraph cluster21573 { label="Project"; 9642 [labelType="html" label="MapPartitionsRDD [9642]<br>run at <unknown>:0"]; } subgraph cluster21569 { label="WholeStageCodegen (1)"; 9643 [labelType="html" label="MapPartitionsRDD [9643]<br>run at <unknown>:0"]; } subgraph cluster21591 { label="WholeStageCodegen (1)"; 9651 [labelType="html" label="MapPartitionsRDD [9651]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21590 { label="Filter"; 9652 [labelType="html" label="MapPartitionsRDD [9652]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21589 { label="Project"; 9653 [labelType="html" label="MapPartitionsRDD [9653]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21586 { label="WholeStageCodegen (2)"; 9654 [labelType="html" label="MapPartitionsRDD [9654]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21585 { label="Project"; 9655 [labelType="html" label="MapPartitionsRDD [9655]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21584 { label="DeserializeToObject"; 9656 [labelType="html" label="MapPartitionsRDD [9656]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21583 { label="MapPartitions"; 9657 [labelType="html" label="MapPartitionsRDD [9657]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21593 { label="mapPartitions"; 9659 [labelType="html" label="MapPartitionsRDD [9659]<br>toJavaRDD at <unknown>:0"]; } } 9640->9641; 9641->9642; 9642->9643; 9643->9644; 9644->9651; 9651->9652; 9652->9653; 9653->9654; 9654->9655; 9655->9656; 9656->9657; 9657->9658; 9658->9659; 9659->9660; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time