Section 034 - Apache Spark using Python - Processing Column Data

18 videos • 465 views • by itversity In this section we will get an overview of Predefined Functions in Spark. Below are the following topics covered in this module. Overview of Predefined Functions in Spark Create Dummy Data Frame Categories of Functions Special Functions - col and lit Common String Manipulation Functions Extracting Strings using substring Extracting Strings using split Padding Characters around Strings Trimming Characters from Strings Date and Time Manipulation Functions Date and Time Arithmetic Using Date and Time Trunc Functions Date and Time Extract Functions Using to_date and to_timestamp Using date_format Function Dealing with Unix Timestamp Dealing with Nulls Using CASE and WHEN