PokeVideoPlayer v0.9-rev1 - licensed under gpl3-or-later
ImmersiveAmbientModecolor: #f2e9dd (color 1)
Video Format : (720p) openh264 ( https://github.com/cisco/openh264) mp4a.40.2 | 44100Hz
Audio Format: 140 ( High )
PokeTubeEncryptID: 2734f99cba5561356ad624f1aafa132d7028093d7f888e9b5d9d51756bac4e07098428fcd5923140a5bd7793061c9f79
Proxy : eu-proxy.poketube.fun - refresh the page to change the proxy location
Date : 1728075643169 - unknown on Apple WebKit
Mystery text : UTZtZzM1cVFaNDQgaSAgbG92ICB1IGV1LXByb3h5LnBva2V0dWJlLmZ1bg==
143 : true
4,369 Views β’ Mar 26, 2024 β’ Click to toggle off description
In this video, we will understand the how a Spark Job gets Executed - An execution plan in Apache Spark outlines the sequence of operations that will be performed when a Spark job is run. This plan is built based on the transformations and actions defined in the Spark application code and is optimized for efficient execution. Here's a simplified overview of how Spark generates and executes an execution plan: Spark Application Code - Logical Plan - Optimization - Physical Plan - RDD lineage - Task Execution
One of the most common interview questions when you are applying for any data based roles such as data analyst, data engineer, data scientist or data manager.
Don't miss out - Subscribe to the channel for more such interesting information
Social Media Links :
LinkedIn - www.linkedin.com/in/bigdatabysumit/
Twitter - twitter.com/bigdatasumit
Instagram - www.instagram.com/bigdatabysumit/
Website - trendytech.in/?src=youtube&sub=mockdecshort
#DataWarehouse #DataLake #DataLakehouse #DataManagement #TechTrends2024 #DataAnalysis #BusinessIntelligencen #2024 #interview #interviewquestions #interviewpreparation
Views : 4,369
Genre:
Uploaded At Mar 26, 2024 ^^
warning: returnyoutubedislikes may not be accurate, this is just an estiment ehe :3
Rating : 4.906 (4/167 LTDR)
97.66% of the users lieked the video!!
2.34% of the users dislieked the video!!
User score: 96.49- Overwhelmingly Positive
RYD date created : 2024-09-11T06:03:04.672371Z
See in json
YouTube Comments - 5 Comments
Top Comments of this video!! :3
This is not Architecture... This is internal working
2 |
This is explain plan not architecture :(
1 |
@naveena2226
6 months ago
First when spark application is submitted, it will run driver program to create the spark session and then the logical plan is created and based on the logical plan there will be multiple physical plans , cost analysis will be done on all suggested physical plan and then best physical plan will be created . And then the task is submitted to multiple worker nodes to execute the task (resource manager will take care of allocating the resources to job). Actually the driver program submitted the application to cluster before dividing into tasks..
Once the execution is done the result will be sent to driver node and driver node shows rhe result to us
5 |