Holland returned to the Commons in 1899, when he won a by-election at Rotherham caused by the resignation of Arthur Acland. He was knighted in the 1902 Coronation Honours, receiving the accolade from King Edward VII at Buckingham Palace on 24 October that year, and made a Baronet, of Queen's Gate in the Royal Borough of Kensington in 1907. He was a member of a number of parliamentary and other governmental committees including the Indian Currency Committee, the Advisory Committee on Commercial Intelligence and the Committee on Joint Stock Companies. From 1908 - 1910 was acting Chairman of Ways and Means. He was also a commissioner for the international exhibitions held in Paris in 1900, Milan in 1906 and Brussels in 1910.