3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1211 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 483
Associated Job Ids:
1212
DAG Visualization
digraph G { subgraph clusterstage_1211 { label="Stage 1211"; 12731 [labelType="html" label="SQLExecutionRDD [12731]<br>run at <unknown>:0"]; 12739 [labelType="html" label="SQLExecutionRDD [12739]<br>toJavaRDD at <unknown>:0"]; 12741 [labelType="html" label="PythonRDD [12741]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster28483 { label="MicroBatchScan"; 12727 [labelType="html" label="DataSourceRDD [12727]<br>run at <unknown>:0"]; 12728 [labelType="html" label="MapPartitionsRDD [12728]<br>run at <unknown>:0"]; } subgraph cluster28482 { label="Project"; 12729 [labelType="html" label="MapPartitionsRDD [12729]<br>run at <unknown>:0"]; } subgraph cluster28478 { label="WholeStageCodegen (1)"; 12730 [labelType="html" label="MapPartitionsRDD [12730]<br>run at <unknown>:0"]; } subgraph cluster28492 { label="WholeStageCodegen (1)"; 12732 [labelType="html" label="MapPartitionsRDD [12732]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28491 { label="Filter"; 12733 [labelType="html" label="MapPartitionsRDD [12733]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28490 { label="Project"; 12734 [labelType="html" label="MapPartitionsRDD [12734]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28487 { label="WholeStageCodegen (2)"; 12735 [labelType="html" label="MapPartitionsRDD [12735]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28486 { label="Project"; 12736 [labelType="html" label="MapPartitionsRDD [12736]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28485 { label="DeserializeToObject"; 12737 [labelType="html" label="MapPartitionsRDD [12737]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28484 { label="MapPartitions"; 12738 [labelType="html" label="MapPartitionsRDD [12738]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28494 { label="mapPartitions"; 12740 [labelType="html" label="MapPartitionsRDD [12740]<br>toJavaRDD at <unknown>:0"]; } } 12727->12728; 12728->12729; 12729->12730; 12730->12731; 12731->12732; 12732->12733; 12733->12734; 12734->12735; 12735->12736; 12736->12737; 12737->12738; 12738->12739; 12739->12740; 12740->12741; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time