We actually don't need to clean up Makefile.PL if we don't build it