Added ability to remove labels

Have @anfleene take a quick look at this.  Seems reasonable to me, but I wouldn't mind a second set of eyes on it.