You will not be able to live in these places the rest of your life.  Lose your licence you are toast.  People don't backpack forever.  Body parts fail and the medical care is abysmal once you leave the larger centres.  You currently live in one of the only places in Canada where you can walk to everything, have decent transit and lots of stimulation.  So give it up to look at snow and shop in the local strip mall.  It makes zero sense and smacks of age denial.  Your body will fail you before you know it and backpacking won't be possible.   Once you move out of the GTA it's going to be very hard to buy back in.