3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 714 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 402
Associated Job Ids:
715
DAG Visualization
digraph G { subgraph clusterstage_714 { label="Stage 714"; 7508 [labelType="html" label="SQLExecutionRDD [7508]<br>run at <unknown>:0"]; 7516 [labelType="html" label="SQLExecutionRDD [7516]<br>toJavaRDD at <unknown>:0"]; 7518 [labelType="html" label="PythonRDD [7518]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16788 { label="MicroBatchScan"; 7504 [labelType="html" label="DataSourceRDD [7504]<br>run at <unknown>:0"]; 7505 [labelType="html" label="MapPartitionsRDD [7505]<br>run at <unknown>:0"]; } subgraph cluster16787 { label="Project"; 7506 [labelType="html" label="MapPartitionsRDD [7506]<br>run at <unknown>:0"]; } subgraph cluster16783 { label="WholeStageCodegen (1)"; 7507 [labelType="html" label="MapPartitionsRDD [7507]<br>run at <unknown>:0"]; } subgraph cluster16797 { label="WholeStageCodegen (1)"; 7509 [labelType="html" label="MapPartitionsRDD [7509]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16796 { label="Filter"; 7510 [labelType="html" label="MapPartitionsRDD [7510]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16795 { label="Project"; 7511 [labelType="html" label="MapPartitionsRDD [7511]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16792 { label="WholeStageCodegen (2)"; 7512 [labelType="html" label="MapPartitionsRDD [7512]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16791 { label="Project"; 7513 [labelType="html" label="MapPartitionsRDD [7513]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16790 { label="DeserializeToObject"; 7514 [labelType="html" label="MapPartitionsRDD [7514]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16789 { label="MapPartitions"; 7515 [labelType="html" label="MapPartitionsRDD [7515]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16799 { label="mapPartitions"; 7517 [labelType="html" label="MapPartitionsRDD [7517]<br>toJavaRDD at <unknown>:0"]; } } 7504->7505; 7505->7506; 7506->7507; 7507->7508; 7508->7509; 7509->7510; 7510->7511; 7511->7512; 7512->7513; 7513->7514; 7514->7515; 7515->7516; 7516->7517; 7517->7518; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time