Why Airflow?
37 videos • 740 views • by The Data Guy
1
How Airflow Can Bring Increased Flexibility and Resiliency to your Data Pipelines!
The Data Guy
Download
2
Airflow Vs. Dagster: The Full Breakdown!
The Data Guy
Download
3
Databricks Vs. Airflow for ETL Workflows!
The Data Guy
Download
4
Why Airflow?
The Data Guy
Download
5
What is a Data Pipeline?
The Data Guy
Download
6
Airflow Summit 2023 Recap!
The Data Guy
Download
7
Intro to Airflow! Beginner's Guide to Getting Started with Airflow
The Data Guy
Download
8
The Airflow AI: Ask Astro
The Data Guy
Download
9
Airflow Vs. Prefect Part 1: Data Guys Debate!
The Data Guy
Download
10
Airflow Vs. Prefect Part 2: Data Guys Debate
The Data Guy
Download
11
How to Submit a PySpark Script to a Spark Cluster Using Airflow!
The Data Guy
Download
12
Submitting PySpark Jobs to Databricks: ETL Workflows with Airflow Explained!
The Data Guy
Download
13
How to Create a Data Streaming Pipeline with Databricks Spark, Apache Kafka, and Airflow!
The Data Guy
Download
14
How to Perform Data Quality Checks on a Postgres Database
The Data Guy
Download
15
How to Build an ETL Pipeline with Postgres, Azure Data Factory, and Airflow!
The Data Guy
Download
16
How to Create an Unstructured Data Processing Pipeline Using Airflow and OpenAI!
The Data Guy
Download
17
Airflow 2.8 Update Overview! All the Latest Airflow Changes Explained
The Data Guy
Download
18
How to Use Kubernetes Locally with Airflow!
The Data Guy
Download
19
How to Run AWS Glue Jobs with Airflow! Use Airflow to Manage Amazon Glue Jobs
The Data Guy
Download
20
End to End Web Scraping and ML Data Pipeline Project Using Airflow, LangChain and OpenAI!
The Data Guy
Download
21
How to Add Microsoft Teams Alerts to Your Airflow Pipeline!
The Data Guy
Download
22
End to End AI Recommendation Pipeline with Cohere and Airflow!
The Data Guy
Download
23
End to End Parallel Data Quality Check Pipeline Project with Airflow and Snowflake!
The Data Guy
Download
24
How to Sync Data Between S3 Buckets Using AWS DataSync and Airflow!
The Data Guy
Download
25
How to Back-Up/Migrate Data from AWS DynamoDB to an S3 Bucket with Airflow!
The Data Guy
Download
26
How to Migrate Data From an Oracle Database to a Snowflake Database Using Airflow!
The Data Guy
Download
27
Everything New in Airflow 2.9! Apache Airflow 2.9 Release Notes!
The Data Guy
Download
28
How to Manage Google DataFlow Workflows with Apache Airflow!
The Data Guy
Download
29
How to Use Airflow's New Object Store Object! Airflow Object Store Guide!
The Data Guy
Download
30
End-to-End MLOp's Pipeline Example with Airflow, Weaviate, and OpenAI!
The Data Guy
Download
31
What is Linearizability? Linearizability in Distributed Systems Explained!
The Data Guy
Download
32
Apache Spark Vs. Apache Flink Vs. Apache Kafka Vs. Apache Storm! Data Streaming Tools Compared!
The Data Guy
Download
33
How to Do Machine Learning Operations in Production with Airflow! MLOp's Production Pipeline Example
The Data Guy
Download
34
How to Migrate Airflow DAG Metadata from One Airflow Environment to Another Using Airflow!
The Data Guy
Download
35
End-to-End Postgres to Data Lake Data Processing Pipeline with Apache Spark, Airflow, and Minio!
The Data Guy
Download
36
Everything New in Airflow 2.10!
The Data Guy
Download
37
End-to-End Parallel ETL Pipeline with Airflow, Snowflake, and S3 Buckets!
The Data Guy
Download