To recover from a manual link penalty you will need to remove bad backlinks. This can be done by either reaching out to the site owner or disavowing them.