To add a new language in Magnolia CMS, you set up 'locales' in the system. You can choose different languages for your website and Admin Central. For the website, you can create different language options by changing the settings in the 'Sites' app. This way, you can manage translations and make sure users can see content in their preferred language.