Get a hacker off your phone with antivirus software You'll be hard-pressed to find a more effective way to get rid of hackers than to use an app specifically designed just for that. Android antivirus software promptly quarantines malicious code used by hackers to compromise your phone.