Test env in CI and remove matrix build