The castle isn't Scotty's, his rich friends from out east built it as their summer house around the 1920s.