Improve access management for attribute groups

| Q                    | A
| -------------------- | ---
| Bug fix?             | Y
| New feature?         | N
| BC breaks?           | N
| CI currently passes? | Y
| Tests pass?          | Y
| Scenarios pass?      | Y
| Checkstyle issues?*  | N
| PMD issues?**        |  N
| Changelog updated?   | N
| Fixed tickets        | PIM-3037, PIM-3038
| Doc PR               | ~