[Truffle] Do not try to know the caller class if we ignore the visibility.

* Ideally visbility checking and lookup should be separated.