Make which silent when loading app

I was seeing some ugly errors during boot time, which was refactored into
helper method and stderr sent to `/dev/null`