At 24 stories, it would become known as the "Skyscraper By The Sea