Avoid throwing exception when the same memory provider is attached to
ACL which avoid orchestral/extension#42

Signed-off-by: crynobone <crynobone@gmail.com>