 Smith soon tired of Sloan's off-track antics, which included lavish parties and often arrogant statements that questioned Smith's judgment on the track. A case in point was Sloan's behavior prior to the running of 1897 Brooklyn Handicap which occurred over a sloppy, mud-laden track that year. Sloan had won several races on Belmar, a gray 5-year old by Belvidere, and felt confident that the horse would win the Brooklyn Handicap, openly criticizing Smith's choice of Howard Mann in front of his other employees. However, Smith knew that Belmar was not a fast runner in the mud and that Sloan would not push the horse to win because he disliked being splattered with mud. Smith instead put Skeets Martin, who was better at racing on sloppy tracks, on the 4-year old Howard Mann. He advised Martin to, "Use your own judgment with this horse, and don 't bother about Belmar. Tod probably won't be anywhere near you after the first hundred yards." Howard Mann won easily, winning $ 50,000 for Smith, while Belmar finished in 8th place. When James R. Keene asked Smith in late 1897 for permission to take Sloan to England to race in the Cambridgeshire Handicap, Smith accepted the offer. Sloan achieved great success while racing in England, but he lost his racing license permanently in 1900. Sloan and Smith remained friends after dissolving their partnership, the later loaning Sloan $ 5,000 without interest after his license was revoked. After Sloan's departure, Smith used Skeets Martin as his principal jockey, but in 1899 Martin also left the US for better racing prospects in England. Willie Shaw was ultimately hired to replace Sloan and raced for Smith from 1899 until 1903.
