About
I’m Soumil Nitin Shah, a Lead Data Engineer and Apache Hudi expert with extensive experience in AWS Big Data and data lakes. I specialize in designing scalable data ingestion frameworks, managing over 2TB of data monthly, and optimizing workflows with my innovative "LakeBoost" framework, which integrates Apache Hudi with AWS Glue ETL to enhance efficiency and reduce costs. Additionally, I am a committed content creator with a YouTube channel boasting 42,000 subscribers and over 1,000 videos on big data technologies. My work reflects a strong dedication to advancing the field of data engineering through both technical innovation and educational outreach.
I’m Soumil Nitin Shah, a Lead Data Engineer and Apache Hudi expert with extensive experience in AWS Big Data and data lakes. I specialize in designing scalable data ingestion frameworks, managing over 2TB of data monthly, and optimizing workflows with my innovative "LakeBoost" framework, which integrates Apache Hudi with AWS Glue ETL to enhance efficiency and reduce costs. Additionally, I am a committed content creator with a YouTube channel boasting 42,000 subscribers and over 1,000 videos on big data technologies. My work reflects a strong dedication to advancing the field of data engineering through both technical innovation and educational outreach.