3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 743 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 505
Associated Job Ids:
744
DAG Visualization
digraph G { subgraph clusterstage_743 { label="Stage 743"; 7817 [labelType="html" label="SQLExecutionRDD [7817]<br>run at <unknown>:0"]; 7825 [labelType="html" label="SQLExecutionRDD [7825]<br>toJavaRDD at <unknown>:0"]; 7827 [labelType="html" label="PythonRDD [7827]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster17485 { label="MicroBatchScan"; 7813 [labelType="html" label="DataSourceRDD [7813]<br>run at <unknown>:0"]; 7814 [labelType="html" label="MapPartitionsRDD [7814]<br>run at <unknown>:0"]; } subgraph cluster17484 { label="Project"; 7815 [labelType="html" label="MapPartitionsRDD [7815]<br>run at <unknown>:0"]; } subgraph cluster17480 { label="WholeStageCodegen (1)"; 7816 [labelType="html" label="MapPartitionsRDD [7816]<br>run at <unknown>:0"]; } subgraph cluster17494 { label="WholeStageCodegen (1)"; 7818 [labelType="html" label="MapPartitionsRDD [7818]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17493 { label="Filter"; 7819 [labelType="html" label="MapPartitionsRDD [7819]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17492 { label="Project"; 7820 [labelType="html" label="MapPartitionsRDD [7820]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17489 { label="WholeStageCodegen (2)"; 7821 [labelType="html" label="MapPartitionsRDD [7821]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17488 { label="Project"; 7822 [labelType="html" label="MapPartitionsRDD [7822]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17487 { label="DeserializeToObject"; 7823 [labelType="html" label="MapPartitionsRDD [7823]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17486 { label="MapPartitions"; 7824 [labelType="html" label="MapPartitionsRDD [7824]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17496 { label="mapPartitions"; 7826 [labelType="html" label="MapPartitionsRDD [7826]<br>toJavaRDD at <unknown>:0"]; } } 7813->7814; 7814->7815; 7815->7816; 7816->7817; 7817->7818; 7818->7819; 7819->7820; 7820->7821; 7821->7822; 7822->7823; 7823->7824; 7824->7825; 7825->7826; 7826->7827; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time