Makefile: Do not clear rpm_source_dir

It's shared by all rpms; we wouldn't like to interfere with other
builds.