Fixes #5939 Allow for delegate hosts that are not in inventory