It's not rude. They're just using their first language. If you moved to a foreign speaking country you'd learn the language to get by but if you met someone from your own country you'd automatically begin speaking your first language together.