3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 906 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 430
Associated Job Ids:
907
DAG Visualization
digraph G { subgraph clusterstage_906 { label="Stage 906"; 9518 [labelType="html" label="SQLExecutionRDD [9518]<br>run at <unknown>:0"]; 9532 [labelType="html" label="SQLExecutionRDD [9532]<br>toJavaRDD at <unknown>:0"]; 9534 [labelType="html" label="PythonRDD [9534]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster21292 { label="MicroBatchScan"; 9514 [labelType="html" label="DataSourceRDD [9514]<br>run at <unknown>:0"]; 9515 [labelType="html" label="MapPartitionsRDD [9515]<br>run at <unknown>:0"]; } subgraph cluster21291 { label="Project"; 9516 [labelType="html" label="MapPartitionsRDD [9516]<br>run at <unknown>:0"]; } subgraph cluster21287 { label="WholeStageCodegen (1)"; 9517 [labelType="html" label="MapPartitionsRDD [9517]<br>run at <unknown>:0"]; } subgraph cluster21309 { label="WholeStageCodegen (1)"; 9525 [labelType="html" label="MapPartitionsRDD [9525]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21308 { label="Filter"; 9526 [labelType="html" label="MapPartitionsRDD [9526]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21307 { label="Project"; 9527 [labelType="html" label="MapPartitionsRDD [9527]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21304 { label="WholeStageCodegen (2)"; 9528 [labelType="html" label="MapPartitionsRDD [9528]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21303 { label="Project"; 9529 [labelType="html" label="MapPartitionsRDD [9529]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21302 { label="DeserializeToObject"; 9530 [labelType="html" label="MapPartitionsRDD [9530]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21301 { label="MapPartitions"; 9531 [labelType="html" label="MapPartitionsRDD [9531]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21311 { label="mapPartitions"; 9533 [labelType="html" label="MapPartitionsRDD [9533]<br>toJavaRDD at <unknown>:0"]; } } 9514->9515; 9515->9516; 9516->9517; 9517->9518; 9518->9525; 9525->9526; 9526->9527; 9527->9528; 9528->9529; 9529->9530; 9530->9531; 9531->9532; 9532->9533; 9533->9534; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time