3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 431 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 513
Associated Job Ids:
432
DAG Visualization
digraph G { subgraph clusterstage_431 { label="Stage 431"; 4541 [labelType="html" label="SQLExecutionRDD [4541]<br>run at <unknown>:0"]; 4549 [labelType="html" label="SQLExecutionRDD [4549]<br>toJavaRDD at <unknown>:0"]; 4551 [labelType="html" label="PythonRDD [4551]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10153 { label="MicroBatchScan"; 4537 [labelType="html" label="DataSourceRDD [4537]<br>run at <unknown>:0"]; 4538 [labelType="html" label="MapPartitionsRDD [4538]<br>run at <unknown>:0"]; } subgraph cluster10152 { label="Project"; 4539 [labelType="html" label="MapPartitionsRDD [4539]<br>run at <unknown>:0"]; } subgraph cluster10148 { label="WholeStageCodegen (1)"; 4540 [labelType="html" label="MapPartitionsRDD [4540]<br>run at <unknown>:0"]; } subgraph cluster10162 { label="WholeStageCodegen (1)"; 4542 [labelType="html" label="MapPartitionsRDD [4542]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10161 { label="Filter"; 4543 [labelType="html" label="MapPartitionsRDD [4543]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10160 { label="Project"; 4544 [labelType="html" label="MapPartitionsRDD [4544]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10157 { label="WholeStageCodegen (2)"; 4545 [labelType="html" label="MapPartitionsRDD [4545]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10156 { label="Project"; 4546 [labelType="html" label="MapPartitionsRDD [4546]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10155 { label="DeserializeToObject"; 4547 [labelType="html" label="MapPartitionsRDD [4547]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10154 { label="MapPartitions"; 4548 [labelType="html" label="MapPartitionsRDD [4548]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10164 { label="mapPartitions"; 4550 [labelType="html" label="MapPartitionsRDD [4550]<br>toJavaRDD at <unknown>:0"]; } } 4537->4538; 4538->4539; 4539->4540; 4540->4541; 4541->4542; 4542->4543; 4543->4544; 4544->4545; 4545->4546; 4546->4547; 4547->4548; 4548->4549; 4549->4550; 4550->4551; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time