If the plugin is deleted, the block will no longer work as intended and the code will be written as plain text. This could cause WordPress to read the code. As such, delete all instances of the block before deleting it.