well they certainly are living off our expense at our expense
They are not living on our expense. 
mnli hypothesis: They are not living on our expense.  premise: well they certainly are living off our expense at our expense