You cannot move to Japan while maintaining your US LLC. If you are moving to Japan with a business, you must satisfy the requirements for the Business Manager Visa. This visa is designed for individuals who are planning to establish, manage, or operate a business in Japan.