A New MIT Study Shows Reinforcement Learning Minimizes Catastrophic Forgetting Compared to Supervised Fine-Tuning | Insights by Willow Ventures
Understanding Catastrophic Forgetting in Foundation Models In the realm of artificial intelligence, foundation models are transforming how tasks across multiple domains are approached. However, a significant challenge known as catastrophic forgetting limits their ability to retain previously acquired skills when fine-tuned for new tasks. What is Catastrophic Forgetting? Catastrophic forgetting refers to the phenomenon whereby […]
