If isPayer, then address stuff is required and vice versa