While it is OK to delete a page or blog post from your site, it is highly recommended to put a 301 redirect in place afterwards. This will make sure that anyone who attempts to go to that URL is redirected to a a new relevant, working page so that they do not land on a "404 error" page.