Milne-Eddington inversion including systematics modeled with an RVM