3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 664 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 401
Associated Job Ids:
664
DAG Visualization
digraph G { subgraph clusterstage_664 { label="Stage 664"; 6976 [labelType="html" label="SQLExecutionRDD [6976]<br>run at <unknown>:0"]; 6984 [labelType="html" label="SQLExecutionRDD [6984]<br>toJavaRDD at <unknown>:0"]; 6986 [labelType="html" label="PythonRDD [6986]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster15609 { label="MicroBatchScan"; 6972 [labelType="html" label="DataSourceRDD [6972]<br>run at <unknown>:0"]; 6973 [labelType="html" label="MapPartitionsRDD [6973]<br>run at <unknown>:0"]; } subgraph cluster15608 { label="Project"; 6974 [labelType="html" label="MapPartitionsRDD [6974]<br>run at <unknown>:0"]; } subgraph cluster15604 { label="WholeStageCodegen (1)"; 6975 [labelType="html" label="MapPartitionsRDD [6975]<br>run at <unknown>:0"]; } subgraph cluster15618 { label="WholeStageCodegen (1)"; 6977 [labelType="html" label="MapPartitionsRDD [6977]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15617 { label="Filter"; 6978 [labelType="html" label="MapPartitionsRDD [6978]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15616 { label="Project"; 6979 [labelType="html" label="MapPartitionsRDD [6979]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15613 { label="WholeStageCodegen (2)"; 6980 [labelType="html" label="MapPartitionsRDD [6980]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15612 { label="Project"; 6981 [labelType="html" label="MapPartitionsRDD [6981]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15611 { label="DeserializeToObject"; 6982 [labelType="html" label="MapPartitionsRDD [6982]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15610 { label="MapPartitions"; 6983 [labelType="html" label="MapPartitionsRDD [6983]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15620 { label="mapPartitions"; 6985 [labelType="html" label="MapPartitionsRDD [6985]<br>toJavaRDD at <unknown>:0"]; } } 6972->6973; 6973->6974; 6974->6975; 6975->6976; 6976->6977; 6977->6978; 6978->6979; 6979->6980; 6980->6981; 6981->6982; 6982->6983; 6983->6984; 6984->6985; 6985->6986; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time