Don't overwrite existing AccessChange when adding duplicate.

This made the call to merge completely pointless.

Noticed by @skyboy in Forge IRC.