It's highly debatable. In the exiled lands gold and silver are found in opposite corners of the map, so if you have the resources it can sometimes be worth the trouble to save you some travel, however fast travel negates a lot of this. In Siptah, gold and silver are so plentiful that farming it would be counterintuitive. Generally, I wouldn't recommend it, but if you're playing on a pve server or in co-op, it can be a fun side project to tackle with your friends.