You can. However, it may prove troublesome to find silver without a Wishbone. It is rare for a silver vein to spawn in a visible area, poking out of the mountainside. It would be like trying to find a needle in a haystack otherwise.