Remove plugin manager and observer classes

We don't really need the observer pattern, so let's simplify the code.