Don't use the "soft" magic db

It doesn't help us determine if the file is binary or not, and just
seems to create a bunch of problems like the ones in #4

/cc @6 @malsharman