Update fuse.spec

As the hack also does not apply to x86_64, also exclude it