added support for automatic pagination traversal