Remove redundant code

Intersecting with the empty set always yields the empty set. There is
no need for an explicit check.