Yes, unfortunately, people can access and even control your phone remotely. There are plenty of spyware apps and bugs that let people hack into your phone without you even knowing about it. It's usually through certain links or credentials that hackers do this.