Permanent residency in Australia provides varied travel freedoms, and a permanent visa and grant notification letter will detail your right to re-entry, which is normally unlimited for the first five years. After that, if you leave Australia without a Resident Return Visa, you can lose the right to return to the country as a resident.