Generative AI: Foundation Models (LLMs and Diffusion)

This Pathway covers transformer architecture, training paradigms, and key applications like text/code generation and image synthesis. It focusses on scaling laws and emergent abilities.

After completing this Pathway, you will be able to:

• Devise the transformer architecture and it's role in modern LLMs and Diffusion models
• Change prompt engineering and fine-tuning techniques to adapt models for specific tasks, capabilities and limitations of state-of-the-art foundation models