From my own experience living in Asia, it is absolutely not a problem.
I am not a native English speaker myself, and neither are the people over there. Actually, in some cases, (Japan in mind) they even prefer you speaking the local language.
That said, it is important to have a good level of English, and some capabilities in the local language will be a big plus.