Victoria's place was quiet and had everything you need for some days in Toronto. With bus and subway you need around 60min to the waterfront. Maybe there is a faster way. :)
Best regards
Vincent