build: Remove unused flags

Fixes commit e5a83ebfc16bb6607bf946535ef55c50d416a8b6.