I changed the circuit. Added a capacitor and a 1k inline resistor to the piezo speaker to smooth out and slightly lower the volume.

Added a debounce to the button.