SetSort::at should return based on the sort

Right now, `SetSort::at` delegates to its base ... but it should use the sort instead.