Make sure binaries exist before we call them, this is important for upgrade path