While it can be helpful to know some basic Japanese phrases, English signage and translation services are widely available in tourist areas. You can get by without knowing Japanese.