Honestly traveling to asian countries shouldn't really be too big problem as long as you act respectfully (don't act like "stupid american").
Countries like japan and south korea have a lot of tourism so many places have made it so that it can be easy for foreigners. Even though many people maybe don't speak so good english it's still possible to get around by using simple english (showing picture of something and saying "I want this" or "Where is this?"). Also the google translate and google maps is very usefull for traveling to these countries. Imo Japan is a must see country, it has so many good places to see, the culture, the system, the food and a lot more stuff is just so great.
TL;DR: I don't think you should not go to a country because of language barrier. Just remember to respect the people and speak simple english (or even learn some words of that language) and everything should be fine honestly.