Yes, you can. Use the search 'in:unread in:' to find all unread messages in a specified label, and then use the advice above to remove the messages.