Restructured pipeline so that objects point to other objects

Used to have each thing having a list of things that pointed to it.
Now, each thing has a list of things it points to, a lot more intuitive.