A recent change caused a performance problem when first loading my repository

This was introduced in 65a0c10b1f29.

There is no need to check if items are in a set before adding them, because NSMutableSet already makes sure the added objectes are unique (see `-[NSMutableSet addObject:]` docs).