3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1595 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 432
Associated Job Ids:
1596
DAG Visualization
digraph G { subgraph clusterstage_1595 { label="Stage 1595"; 16763 [labelType="html" label="SQLExecutionRDD [16763]<br>run at <unknown>:0"]; 16771 [labelType="html" label="SQLExecutionRDD [16771]<br>toJavaRDD at <unknown>:0"]; 16773 [labelType="html" label="PythonRDD [16773]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster37507 { label="MicroBatchScan"; 16759 [labelType="html" label="DataSourceRDD [16759]<br>run at <unknown>:0"]; 16760 [labelType="html" label="MapPartitionsRDD [16760]<br>run at <unknown>:0"]; } subgraph cluster37506 { label="Project"; 16761 [labelType="html" label="MapPartitionsRDD [16761]<br>run at <unknown>:0"]; } subgraph cluster37502 { label="WholeStageCodegen (1)"; 16762 [labelType="html" label="MapPartitionsRDD [16762]<br>run at <unknown>:0"]; } subgraph cluster37516 { label="WholeStageCodegen (1)"; 16764 [labelType="html" label="MapPartitionsRDD [16764]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster37515 { label="Filter"; 16765 [labelType="html" label="MapPartitionsRDD [16765]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster37514 { label="Project"; 16766 [labelType="html" label="MapPartitionsRDD [16766]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster37511 { label="WholeStageCodegen (2)"; 16767 [labelType="html" label="MapPartitionsRDD [16767]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster37510 { label="Project"; 16768 [labelType="html" label="MapPartitionsRDD [16768]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster37509 { label="DeserializeToObject"; 16769 [labelType="html" label="MapPartitionsRDD [16769]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster37508 { label="MapPartitions"; 16770 [labelType="html" label="MapPartitionsRDD [16770]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster37518 { label="mapPartitions"; 16772 [labelType="html" label="MapPartitionsRDD [16772]<br>toJavaRDD at <unknown>:0"]; } } 16759->16760; 16760->16761; 16761->16762; 16762->16763; 16763->16764; 16764->16765; 16765->16766; 16766->16767; 16767->16768; 16768->16769; 16769->16770; 16770->16771; 16771->16772; 16772->16773; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time