We recommend it. While many HDMI switchers are designed to detect power and signals, in reality, it doesn’t always work. Some switchers can’t get enough power to operate if only one source is turned on, so a second source needs to be powered up, which can interfere with the sensors. Apple TV’s “always-on” feature is notorious for complicating things. Without a remote, you could be left getting up and toggling the switcher manually, one of the problems you were trying to avoid when you bought the unit.