3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 622 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 364
Associated Job Ids:
622
DAG Visualization
digraph G { subgraph clusterstage_622 { label="Stage 622"; 6535 [labelType="html" label="SQLExecutionRDD [6535]<br>run at <unknown>:0"]; 6543 [labelType="html" label="SQLExecutionRDD [6543]<br>toJavaRDD at <unknown>:0"]; 6545 [labelType="html" label="PythonRDD [6545]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14622 { label="MicroBatchScan"; 6531 [labelType="html" label="DataSourceRDD [6531]<br>run at <unknown>:0"]; 6532 [labelType="html" label="MapPartitionsRDD [6532]<br>run at <unknown>:0"]; } subgraph cluster14621 { label="Project"; 6533 [labelType="html" label="MapPartitionsRDD [6533]<br>run at <unknown>:0"]; } subgraph cluster14617 { label="WholeStageCodegen (1)"; 6534 [labelType="html" label="MapPartitionsRDD [6534]<br>run at <unknown>:0"]; } subgraph cluster14631 { label="WholeStageCodegen (1)"; 6536 [labelType="html" label="MapPartitionsRDD [6536]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14630 { label="Filter"; 6537 [labelType="html" label="MapPartitionsRDD [6537]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14629 { label="Project"; 6538 [labelType="html" label="MapPartitionsRDD [6538]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14626 { label="WholeStageCodegen (2)"; 6539 [labelType="html" label="MapPartitionsRDD [6539]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14625 { label="Project"; 6540 [labelType="html" label="MapPartitionsRDD [6540]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14624 { label="DeserializeToObject"; 6541 [labelType="html" label="MapPartitionsRDD [6541]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14623 { label="MapPartitions"; 6542 [labelType="html" label="MapPartitionsRDD [6542]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14633 { label="mapPartitions"; 6544 [labelType="html" label="MapPartitionsRDD [6544]<br>toJavaRDD at <unknown>:0"]; } } 6531->6532; 6532->6533; 6533->6534; 6534->6535; 6535->6536; 6536->6537; 6537->6538; 6538->6539; 6539->6540; 6540->6541; 6541->6542; 6542->6543; 6543->6544; 6544->6545; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time