Yes, you can delete a mailbox by swiping left on the mailbox and selecting Delete.