Performance fix: rb_gc_unregister_address is slow