Just realized that i need to aggregate all beliefs from all possible games for all actions.