If you remove the Block Collection from your website, it will no longer be accessible through the design library but it will not affect any blocks that you have added to any of your pages.