Yes, during the validity of the E-2 petition and visa, you are permitted to travel internationally, work or not work for the current employer and work for another employer while abroad.  It should not affect your E2 visa from the immigration standpoint.