Benchmark Transfer After Fine-Tuning: How LLMs Keep Their General Skills When Learning New Tasks
Fine-tuning LLMs for specific tasks can erase their general knowledge. Learn how benchmark transfer ensures models stay smart across all tasks - not just the one you trained them for.