Tighten up the special case in GVN to avoid ptr->ptr casts going via inttoptr.

Fixes #69