Yes, you can delete the only fans app from your phone. However, you should consider that you will also be removing all the app's benefits