Yes, there are defences available for affray. This includes if you were acting in self-defence.