Add configure args conditionally instead of deleting them