The number of vacant downtown buildings has dropped from nearly 50 to around 13