Don't memoize buffer

I ran into a bug where the import would end up in a different buffer. It
turns out that a past me was a bit stupid and decided to memoize the
buffer in an instance variable.