I moved out, but now he says that sometimes people say things that they don't mean, meaning he didn't really want me to move out. It seems that the reason you initially moved into this man's place was so that he could keep an eye on your belongings while you were out of the country. Having your own places helps both of you to keep your autonomy and individuality while exploring this very new relationship. A relationship takes much time to evolve and mature even under the best circumstances. It's difficult for a mature relationship to pick up after a 4-month hiatus, let alone one that's just in it's beginning stages.
Many people move in together on a whim or simply because it is convenient or cost-effective.
Don' t let these factors come before truly getting to know a person, and being ready to move in with each other for the right reasons. Find out his reasons for doing so. And, while you're at it, find out why he says things he doesn't mean. We all say things in the heat of an argument that we may regret later. Let him know that you are confused and are trying to come to terms with his infidelity.