Remove xifo package

The only structure that is used is simple enough to be in-package.

This is a last in my tranch of code pruning PRs.