3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 854 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 413
Associated Job Ids:
854
DAG Visualization
digraph G { subgraph clusterstage_854 { label="Stage 854"; 8971 [labelType="html" label="SQLExecutionRDD [8971]<br>run at <unknown>:0"]; 8979 [labelType="html" label="SQLExecutionRDD [8979]<br>toJavaRDD at <unknown>:0"]; 8981 [labelType="html" label="PythonRDD [8981]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20074 { label="MicroBatchScan"; 8967 [labelType="html" label="DataSourceRDD [8967]<br>run at <unknown>:0"]; 8968 [labelType="html" label="MapPartitionsRDD [8968]<br>run at <unknown>:0"]; } subgraph cluster20073 { label="Project"; 8969 [labelType="html" label="MapPartitionsRDD [8969]<br>run at <unknown>:0"]; } subgraph cluster20069 { label="WholeStageCodegen (1)"; 8970 [labelType="html" label="MapPartitionsRDD [8970]<br>run at <unknown>:0"]; } subgraph cluster20083 { label="WholeStageCodegen (1)"; 8972 [labelType="html" label="MapPartitionsRDD [8972]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20082 { label="Filter"; 8973 [labelType="html" label="MapPartitionsRDD [8973]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20081 { label="Project"; 8974 [labelType="html" label="MapPartitionsRDD [8974]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20078 { label="WholeStageCodegen (2)"; 8975 [labelType="html" label="MapPartitionsRDD [8975]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20077 { label="Project"; 8976 [labelType="html" label="MapPartitionsRDD [8976]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20076 { label="DeserializeToObject"; 8977 [labelType="html" label="MapPartitionsRDD [8977]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20075 { label="MapPartitions"; 8978 [labelType="html" label="MapPartitionsRDD [8978]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20085 { label="mapPartitions"; 8980 [labelType="html" label="MapPartitionsRDD [8980]<br>toJavaRDD at <unknown>:0"]; } } 8967->8968; 8968->8969; 8969->8970; 8970->8971; 8971->8972; 8972->8973; 8973->8974; 8974->8975; 8975->8976; 8976->8977; 8977->8978; 8978->8979; 8979->8980; 8980->8981; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time