Remove inherited config and file-type-specific code.

This functionality needs to fleshed out a bit more. This commit can be
reverted after the initial refactor PR.
Fix failing doctest on systems w/o PIL