They had 'a physical relationship' but it wasn't sexual.
Their relationship was physical but not sexual.