Before revision: Another approach for formulating this problem is POMDP Partially observable Markov decision process.
After revision: Another approach for formulating this problem is a partially observable Markov decision process.