configure: Conditionalize libinput and gbm too