Yes, you can lose fat in a caloric restriction without exercise. But I suggest strength training to help maintain lean active muscle tissue while losing fat. Not just watching the number on the scale go down.