Yes, hackers can breach your router and home network. Sadly, what remote access is capable of doing for you can also be used against you. Cybercriminals can crack your password or exploit security flaws in the firmware.
Make sure you:
regularly update your software,
create strong passwords,
deactivate remote administration,
run virus scans.