To delete infected files in Kaspersky, Click More Tools. Then, under Security, go to Quarantine and open the storage window. Next, select the files you’d like to delete one by one and click Delete. You can also delete all infected files altogether by clicking Delete All.