Later Cameron wished the Lib Dems well in Oldham , sparking more fears among Tories of a " soft " electoral pact in which the Conservatives would in future put up " gesture " candidates in certain seats but not fight them hard to win .