Revert "GPU: add optimization flags to GPU drivers"

This reverts commit 613a2e16be428b97a3d765fc39bc5c98d7c32604.