Preserve a reference to the file listener

So it can be deregistered. Dunno why it disappeared. Probably a bad
merge somewhere