Only remove osv image dir if we are in Xen mode