lib: remove `instanceof` check, demand BN evrwhr
bn: eliminate all instanceof checks
bn: fix isubn