Section 029 - Data Engineering using Spark SQL - Managing Tables - Basic DDL and DML
13 videos • 278 views • by itversity In this module we will learn about Managing Tables - DDL and DML. Below are the following topics covered in this module. Create Spark Metastore Tables Overview of Data Types Adding Comments Loading Data Into Tables - Local Loading Data Into Tables - HDFS Loading Data - Append and Overwrite Creating External Tables Managed Tables vs External Tables Overview of File Formats Drop Tables and Databases Truncating Tables Exercise - Managed Tables Introduction - Managing Tables - DML and Partitioning Introduction to Partitioning Creating Tables using Parquet Load vs Insert Inserting Data using Stage Table Creating Partitioned Tables Adding Partitions to Tables Loading Data into Partitioned Tables Inserting Data into Partitions Using Dynamic Partition Mode Exercise - Partitioned Tables