Revert "Use real NSNumbers instead of uintptr_t hack"

This reverts commit bfc635a4c2dc3f34d0bea5aee4261495dac622f7.