Seacombe house is a great place to stay in an awesome little town. It is located on the corner of Cox and Sackville streets (Sackville st is Port Fairy's main st) so it's almost in the centre of town. The building itself was constructed in 1852, but has been well updated. Everything was clean and pleasant, and staff were exceptional.
I have only rated this accommodation 4 stars because the room was quite small, and staircases are narrow and a bit awkward, so please don't be put off if this is not an issue for you! Otherwise it was great.