Airflow Use Cases
44 videos • 861 views • by The Data Guy
1
Introduction to Machine Learning with Airflow and Snowflake/Snowpark!
The Data Guy
Download
2
How to Migrate Data from MSSQL Server to Snowflake using Airflow!
The Data Guy
Download
3
How to Pass Pandas Dataframes as XCom's in Airflow using a Custom XCom Backend!
The Data Guy
Download
4
Introduction to Machine Learning with MLFlow and Airflow!
The Data Guy
Download
5
How to Use Redshift with Airflow!
The Data Guy
Download
6
How to Migrate Data from an Oracle Database to a Postgres Database Using Airflow!
The Data Guy
Download
7
How to Migrate Data from MongoDB to a MySql Database with Airflow!
The Data Guy
Download
8
How to Submit a PySpark Script to a Spark Cluster Using Airflow!
The Data Guy
Download
9
How to Build an ELT Pipeline with CrateDB and Airflow!
The Data Guy
Download
10
Submitting PySpark Jobs to Databricks: ETL Workflows with Airflow Explained!
The Data Guy
Download
11
How to Create a Cloud Hosted Airflow Environment in 5 Minutes!
The Data Guy
Download
12
End to End Data Processing Pipeline for Customer Analytics and Machine Learning!
The Data Guy
Download
13
Beginner Machine Learning: How to Use a Weaviate for Sentiment Analysis Using Airflow!
The Data Guy
Download
14
How to Create a Data Streaming Pipeline with Databricks Spark, Apache Kafka, and Airflow!
The Data Guy
Download
15
How to Perform Data Quality Checks on a Postgres Database
The Data Guy
Download
16
How to Build an ETL Pipeline with Postgres, Azure Data Factory, and Airflow!
The Data Guy
Download
17
How to Create an ML Prediction Pipeline using Pinecone & Airflow!
The Data Guy
Download
18
How to Create an Unstructured Data Processing Pipeline Using Airflow and OpenAI!
The Data Guy
Download
19
How to Use Kubernetes Locally with Airflow!
The Data Guy
Download
20
How to Run AWS Glue Jobs with Airflow! Use Airflow to Manage Amazon Glue Jobs
The Data Guy
Download
21
How to Pull Information from the Google Rest API and Store it in AWS S3 with Airflow!
The Data Guy
Download
22
How to Run AWS Lambda Functions Using Airflow! How to Get More out of Lambda Functions with Airflow!
The Data Guy
Download
23
How to Create a Data Pipeline with BigQuery and Airflow! Beginner's Guide to BigQuery + Airflow
The Data Guy
Download
24
End-to-End Data Pipeline Project with Change Data Capture Using Postgres, Airflow, and Snowflake!
The Data Guy
Download
25
End to End Web Scraping and ML Data Pipeline Project Using Airflow, LangChain and OpenAI!
The Data Guy
Download
26
How to Add Microsoft Teams Alerts to Your Airflow Pipeline!
The Data Guy
Download
27
End to End AI Recommendation Pipeline with Cohere and Airflow!
The Data Guy
Download
28
End to End Parallel Data Quality Check Pipeline Project with Airflow and Snowflake!
The Data Guy
Download
29
How to Sync Data Between S3 Buckets Using AWS DataSync and Airflow!
The Data Guy
Download
30
How to Back-Up/Migrate Data from AWS DynamoDB to an S3 Bucket with Airflow!
The Data Guy
Download
31
How to Migrate Data From an Oracle Database to a Snowflake Database Using Airflow!
The Data Guy
Download
32
How to Manage Google DataFlow Workflows with Apache Airflow!
The Data Guy
Download
33
How to Use Airflow's New Object Store Object! Airflow Object Store Guide!
The Data Guy
Download
34
End-to-End MLOp's Pipeline Example with Airflow, Weaviate, and OpenAI!
The Data Guy
Download
35
How to Build a Real Time Predictive Analytics Pipeline with Airflow, S3, OpenAI, and Weaviate!
The Data Guy
Download
36
Apache Airflow Vs. Mage.AI! Apache Airflow and Mage.AI Compared for Data Orchestration!
The Data Guy
Download
37
How to Do Machine Learning Operations in Production with Airflow! MLOp's Production Pipeline Example
The Data Guy
Download
38
How to Migrate Airflow DAG Metadata from One Airflow Environment to Another Using Airflow!
The Data Guy
Download
39
How to Migrate Data from a Redshift Database to Any SQL Database Using Airflow!
The Data Guy
Download
40
How to Migrate Data from a Postgres SQL Database to a Snowflake Database Using Apache Airflow!
The Data Guy
Download
41
End-to-End Postgres to Data Lake Data Processing Pipeline with Apache Spark, Airflow, and Minio!
The Data Guy
Download
42
Everything New in Airflow 2.10!
The Data Guy
Download
43
End-to-End Parallel ETL Pipeline with Airflow, Snowflake, and S3 Buckets!
The Data Guy
Download
44
How to Build a BigQuery Ingestion Pipeline from API's, SFTP Servers, and Pub/Sub with Airflow!
The Data Guy
Download