Can't clean `ext`, some gems use it in the require path.