3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1193 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 516
Associated Job Ids:
1194
DAG Visualization
digraph G { subgraph clusterstage_1193 { label="Stage 1193"; 12542 [labelType="html" label="SQLExecutionRDD [12542]<br>run at <unknown>:0"]; 12550 [labelType="html" label="SQLExecutionRDD [12550]<br>toJavaRDD at <unknown>:0"]; 12552 [labelType="html" label="PythonRDD [12552]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster28060 { label="MicroBatchScan"; 12538 [labelType="html" label="DataSourceRDD [12538]<br>run at <unknown>:0"]; 12539 [labelType="html" label="MapPartitionsRDD [12539]<br>run at <unknown>:0"]; } subgraph cluster28059 { label="Project"; 12540 [labelType="html" label="MapPartitionsRDD [12540]<br>run at <unknown>:0"]; } subgraph cluster28055 { label="WholeStageCodegen (1)"; 12541 [labelType="html" label="MapPartitionsRDD [12541]<br>run at <unknown>:0"]; } subgraph cluster28069 { label="WholeStageCodegen (1)"; 12543 [labelType="html" label="MapPartitionsRDD [12543]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28068 { label="Filter"; 12544 [labelType="html" label="MapPartitionsRDD [12544]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28067 { label="Project"; 12545 [labelType="html" label="MapPartitionsRDD [12545]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28064 { label="WholeStageCodegen (2)"; 12546 [labelType="html" label="MapPartitionsRDD [12546]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28063 { label="Project"; 12547 [labelType="html" label="MapPartitionsRDD [12547]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28062 { label="DeserializeToObject"; 12548 [labelType="html" label="MapPartitionsRDD [12548]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28061 { label="MapPartitions"; 12549 [labelType="html" label="MapPartitionsRDD [12549]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28071 { label="mapPartitions"; 12551 [labelType="html" label="MapPartitionsRDD [12551]<br>toJavaRDD at <unknown>:0"]; } } 12538->12539; 12539->12540; 12540->12541; 12541->12542; 12542->12543; 12543->12544; 12544->12545; 12545->12546; 12546->12547; 12547->12548; 12548->12549; 12549->12550; 12550->12551; 12551->12552; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time