Skip the empty Set being emitted

This is unnecessary and unexpected so skipping it.