added pattern matching and archiving features to the pull ingester