The battery compartment cover will stay attached to wherever you installed with the Command Strips. You can slide off the fixture to change batteries.