As it is an annual, it’s not invasive at all. Winter savory grows slowly and takes well to pruning, so you’re safe there too.