Set inverse as an array if the inverse is a HABTM