58:22

Databricks Platform Features - Deep Dive into Delta Lake using Spark SQL

01:08:31

Databricks Platform Features - Deep Dive into Delta Lake using PySpark Data Frames

06:36

Apache Spark Python - Data Processing Overview - Previewing Airlines Data

09:05

Apache Spark Python - Spark Metastore - Create Partitioned Tables

02:47

Apache Spark Python - Spark Metastore - Exploring Spark Catalog

05:02

Apache Spark Python - Development Life Cycle - Setup Virtual Environment and Install Pyspark

02:26

Apache Spark Python - Development Life Cycle - Setup Sample Data

03:10

Apache Spark Python - Development Life Cycle - Getting Started with Spark

07:16

Data Engineering Spark SQL - Windowing Functions - Getting first and last values

05:15

Data Engineering Spark SQL - Windowing Functions - Filtering Window Function Results

06:49

Data Engineering Spark SQL - Windowing Functions - Order of execution of SQL

03:23

Data Engineering Spark SQL - Windowing Functions - Overview of Windowing Functions

10:10

Apache Spark Python - Spark Metastore - Creating Metastore Tables using catalog

06:48

Apache Spark Python - Spark Metastore - Define Schema for Tables using StructType

04:09

Data Engineering Spark SQL - Windowing Functions - Overview of Subqueries

03:47

Apache Spark Python - Transformations - Solution - Get Daily Revenue

05:47

Apache Spark Python - Development Life Cycle - Passing Run Time Arguments

04:40

Apache Spark Python - Development Life Cycle - Setting up Data for Production Validation

03:44

Data Engineering Spark SQL - Windowing Functions - Prepare HR Database

06:43

Apache Spark Python - Development Life Cycle - Process data using Spark APIs

07:12

Apache Spark Python - Data Processing Overview - Overview of Data Frame APIs

05:13

Apache Spark Python - Development Life Cycle - Getting Started with Pycharm

10:18

Apache Spark Python - Data Processing Overview - Overview of Spark Write APIs

04:17

Apache Spark Python - Data Processing Overview - Understanding airlines data

05:06

Apache Spark Python - Spark Metastore - Saving as Partitioned Table

04:55

Apache Spark Python - Data Processing Overview - Overview of Functions

03:39

Apache Spark Python - Transformations - Solution - Get Dormant US Airports

02:08

Data Engineering Spark SQL - Windowing Functions - Introduction - Windowing Functions

04:24

Apache Spark Python - Transformations - Solution - Get Origins without master data

04:53

Apache Spark Python - Development Life Cycle - Productionizing the Code

06:05

Apache Spark Python - Development Life Cycle - Create Function for Spark Session

07:03

Apache Spark Python - Development Life Cycle - Validating Writing Data to Files

11:05

Apache Spark Python - Data Processing Overview - Overview of Spark Read APIs

04:47

Apache Spark Python - Transformations - Solution - Get Daily Revenue rolled up till Yearly

03:44

Apache Spark Python - Transformations - Solution - Get Count of Flights:Airport without data

09:09

Apache Spark Python - Development Life Cycle - Running the application using YARN

06:19

Apache Spark Python - Spark Metastore - Inserting into Existing Tables

07:24

Apache Spark Python - Development Life Cycle - Write data to files

07:44

Apache Spark Python - Data Processing Overview - Starting Spark Context - pyspark

10:38

Data Engineering Spark SQL - Windowing Functions - Aggregations using Windowing Functions

09:14

Apache Spark Python - Development Life Cycle - Detailed Validation of the Application

09:03

Apache Spark Python - Development Life Cycle - Read data from files

07:07

Apache Spark Python - Spark Metastore - Inferring Schema for Tables

06:16

Apache Spark Python - Spark Metastore - Read and Process data from Metastore Tables

02:48

Apache Spark Python - Transformations - Solution - Get Count of Flights without master data

08:56

Apache Spark Python - Spark Metastore - Using Spark SQL

11:22

Data Engineering Spark SQL - Windowing Functions - Ranking using Windowing Functions

04:56

Apache Spark Python - Development Life Cycle - Accessing OS Environment Variables

06:42

Apache Spark Python - Data Processing Overview - Inferring Schema

04:38

Apache Spark Python - Spark Metastore - Creating Temporary Views

11:00

Data Engineering Spark SQL - Windowing Functions - Using LEAD or LAG

07:19

Apache Spark Python - Spark Metastore - Overview of Spark Metastore

01:25

Apache Spark Python - Transformations - Overview of Joins

07:03

Data Engineering Spark SQL - Spark SQL Functions - Query Example - Word Count

05:48

Apache Spark Python - Basic Transformations - Dealing with Nulls while Filtering

07:16

Apache Spark Python - Basic Transformations - Solution - Problem 1 - Get Total Aggregations

08:48

Data Engineering Spark SQL - Spark SQL Functions - Overview of Numeric Functions

04:26

Apache Spark Python - Transformations - Solution - Get Flight Count Per US Airport

03:22

Apache Spark Python - Processing Column Data - Categories of Functions

06:05

Apache Spark Python - Processing Column Data - Dealing with Unix Timestamp