Professor Colin Rallings , director of Plymouth University 's elections centre , pointed out that in 35 council by-elections since Brown took over as prime minister , the Tories have a nine-point lead over Labour .