Key features to consider when choosing a Hi-Fi amplifier include power output, impedance compatibility with your speakers, connectivity options (such as inputs and outputs), build quality, and additional features like tone controls or built-in DACs (Digital-to-Analog Converters) for digital audio playback. Additionally, consider factors like brand reputation and user reviews for reliability and performance.