Speed up Manifest#clean by reducing complexity

Change cleaning old compiled assets from using a O(n^2) to a O(n)
algorithm for finding old files to remove. This matters since there
can be thousands of assets.
Merge pull request #597 from jeltz/faster_clean_assets

Speed up Manifest#clean by reducing complexity