Revert "Disable LTO here so it works globally"

This reverts commit 4133716395fde9ec04555ecd47e6ae448005a8cb.