Yes, you can do this by going to your Friends list, clicking on their name, and choosing 'Remove friend.'