Revert "Try LTO on kernel"

This reverts commit 2e7c64670f1d27acad0d6c488155bf428e7a510f.