Added ability to remove labels

you're still passing the pr_number here