Don't imply -flto with -O4.

We now saturate at -O3.