Yes, you can delete your Gravatar account if you no longer wish to use the service. Keep in mind that doing so will remove your associated avatars from websites that support Gravatar.