It depends on the purpose of hackers and the way they do it. Some malicious software only collects passwords, while others use only the physical hardware of the phone. You should also secure your phone.