speeding up inference by using singleton vectors where possible, and side stepping factorie dot products