Makes apply_permission more explicit
Removes building parent-child relationship from assigning children. Only need to build this from assigning parent.