Manhattan is one of the safest urban areas in America. However if it will create a worry or concern for you it may make sense to leave anything of sentimental attachment at home. I've seen more people wearing Rolex (and other high end) watches in NYC than anywhere, except maybe Vegas.