Found the bug causing incorrect weights in multi-modal, was the viewing angle based noise, but landmarks were not oriented appropriately for each mode.