I added a language (in Region & Language) and then I changed the default display language to the new language. It worked. Now when I changed the display language back to "English" again, it didn't really happen for everything. I see non-English characters in start and search as shown below:
Restarting the system and redoing the whole process don't fix it. How can this be fixed?