Knowledge Distillation, Pruning & Quantization: Techniques for Optimizing AI Models
How can AI become more sustainable in times of climate change? In an extensive course at the Hasso Plattner Institute, I learned the latest techniques for making large language models more efficient and resource-friendly. From knowledge distillation to network pruning and low-bit quantization.