Limit ignore/allowFrom tests to target's children

https://github.com/taye/interact.js/issues/66#issuecomment-54508945