3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1693 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 481
Associated Job Ids:
1694
DAG Visualization
digraph G { subgraph clusterstage_1693 { label="Stage 1693"; 17792 [labelType="html" label="SQLExecutionRDD [17792]<br>run at <unknown>:0"]; 17800 [labelType="html" label="SQLExecutionRDD [17800]<br>toJavaRDD at <unknown>:0"]; 17808 [labelType="html" label="PythonRDD [17808]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster39810 { label="MicroBatchScan"; 17788 [labelType="html" label="DataSourceRDD [17788]<br>run at <unknown>:0"]; 17789 [labelType="html" label="MapPartitionsRDD [17789]<br>run at <unknown>:0"]; } subgraph cluster39809 { label="Project"; 17790 [labelType="html" label="MapPartitionsRDD [17790]<br>run at <unknown>:0"]; } subgraph cluster39805 { label="WholeStageCodegen (1)"; 17791 [labelType="html" label="MapPartitionsRDD [17791]<br>run at <unknown>:0"]; } subgraph cluster39819 { label="WholeStageCodegen (1)"; 17793 [labelType="html" label="MapPartitionsRDD [17793]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39818 { label="Filter"; 17794 [labelType="html" label="MapPartitionsRDD [17794]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39817 { label="Project"; 17795 [labelType="html" label="MapPartitionsRDD [17795]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39814 { label="WholeStageCodegen (2)"; 17796 [labelType="html" label="MapPartitionsRDD [17796]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39813 { label="Project"; 17797 [labelType="html" label="MapPartitionsRDD [17797]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39812 { label="DeserializeToObject"; 17798 [labelType="html" label="MapPartitionsRDD [17798]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39811 { label="MapPartitions"; 17799 [labelType="html" label="MapPartitionsRDD [17799]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39821 { label="mapPartitions"; 17801 [labelType="html" label="MapPartitionsRDD [17801]<br>toJavaRDD at <unknown>:0"]; } } 17788->17789; 17789->17790; 17790->17791; 17791->17792; 17792->17793; 17793->17794; 17794->17795; 17795->17796; 17796->17797; 17797->17798; 17798->17799; 17799->17800; 17800->17801; 17801->17808; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time