Large Language Models: Foundation Models from the Ground Up
32 videos • 49,094 views • by Databricks This course will go live on August 14, 2023 (Monday)! Stay tuned! This course dives into the details of LLM foundation models. You will learn the innovations that led to the proliferation of transformer-based architectures, from encoder models (BERT) to decoder models (GPT), to encoder-decoder models (T5). You will also learn about the recent breakthroughs that led to applications like ChatGPT. You will gain an understanding of the latest advances that continue to improve LLM functionality including Flash Attention, AliBi, and PEFT methods. The course concludes with an overview of multi-modal LLM developments to address NLP problems involving a combination of text, audio, and visual components. All notebooks and slides are available here: https://github.com/databricks-academy... To participate in discussion forums, enroll in our edX course for free here: https://www.edx.org/learn/computer-pr...