Completely destroy build panel

When closing the build panel, calling detach on the view is
not enough. The panel itself must be destroyed as well.

Solves #21