It does not slow down your site speed. It mainly depends on the storage space of your hosting provider. Make sure to clean up the space or upgrade your hosting if you find an issue with your website loading time.