Against a backdrop of a resurgent Conservative party performing well in the polls , while the Lib Dem position has slipped , they might have to rely on support from Labour voters to keep their candidates in Parliament .