Only removes time if it exists