3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 717 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 429
Associated Job Ids:
718
DAG Visualization
digraph G { subgraph clusterstage_717 { label="Stage 717"; 7544 [labelType="html" label="SQLExecutionRDD [7544]<br>run at <unknown>:0"]; 7552 [labelType="html" label="SQLExecutionRDD [7552]<br>toJavaRDD at <unknown>:0"]; 7554 [labelType="html" label="PythonRDD [7554]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16874 { label="MicroBatchScan"; 7540 [labelType="html" label="DataSourceRDD [7540]<br>run at <unknown>:0"]; 7541 [labelType="html" label="MapPartitionsRDD [7541]<br>run at <unknown>:0"]; } subgraph cluster16873 { label="Project"; 7542 [labelType="html" label="MapPartitionsRDD [7542]<br>run at <unknown>:0"]; } subgraph cluster16869 { label="WholeStageCodegen (1)"; 7543 [labelType="html" label="MapPartitionsRDD [7543]<br>run at <unknown>:0"]; } subgraph cluster16883 { label="WholeStageCodegen (1)"; 7545 [labelType="html" label="MapPartitionsRDD [7545]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16882 { label="Filter"; 7546 [labelType="html" label="MapPartitionsRDD [7546]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16881 { label="Project"; 7547 [labelType="html" label="MapPartitionsRDD [7547]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16878 { label="WholeStageCodegen (2)"; 7548 [labelType="html" label="MapPartitionsRDD [7548]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16877 { label="Project"; 7549 [labelType="html" label="MapPartitionsRDD [7549]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16876 { label="DeserializeToObject"; 7550 [labelType="html" label="MapPartitionsRDD [7550]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16875 { label="MapPartitions"; 7551 [labelType="html" label="MapPartitionsRDD [7551]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16885 { label="mapPartitions"; 7553 [labelType="html" label="MapPartitionsRDD [7553]<br>toJavaRDD at <unknown>:0"]; } } 7540->7541; 7541->7542; 7542->7543; 7543->7544; 7544->7545; 7545->7546; 7546->7547; 7547->7548; 7548->7549; 7549->7550; 7550->7551; 7551->7552; 7552->7553; 7553->7554; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time