Premise: 'Shame you work for the mafia, then,' I replied.

Hypothesis: I said i want no part of the mafia to him. 
Relation: neutral