Mansion House is about 1 mi from Castle, one of Scarborough’s most popular landmarks.