Also check allowedaddresspairs for exceptions

Change-Id: Id0ad07e46dcb1108efbf75284c85e72164626234
Partial-Bug: 1363304
Merge "Also check allowedaddresspairs for exceptions"