Revomoving Let's Encrypt SSL certificates from the server is simple, you can use the Command line to do it if you are using VPS. And if you are using shared hosting based on cPanel then you need to follow simple instructions to do it.