As long as you don't portray them as clichés/caricatures, you should be fine. My advice would be... Either mention they speak with an accent but don't go out of your way to show it. Have them speak in their native language but show the English translation on page. Or if you really want to use broken English, do it rarely, thoughtfully, and mildly, i.e. don't put emphasis on it.