Revert "GPU: add optimization flags to GPU drivers"

This reverts commit 36b04b00b8fc6947e14c6aa425dcc8c4dbc4ac95.