twitter comment ingestion fixes

other scatter improvements