Check if remove button is disabled based on class, bail if so