Removing the vagrant group from the default ssh groups in the ssh parameters since these are merged.