Found a new property in Vagrant called adapter_ip which let's me set the VBox adapter's ip address!