Package: jpathpy
Packagejpathpyis easy way for selecting items from objects, that can be iterate by keys or indices (such as dictionaries or lists).Also you can use syntax of JPath for selecting items by string expression.For example, it can be usefull for selecting some items from JSON.Example:>>> from jpathpy import jselection
>>> d = { "books": [
    {"author": "Nigel Rees"},
    {"author": "Evelyn Waugh"},
    {"author": "Herman Melville"},
    {"author": "J. R. R. Tolkien"},
]}
>>> # try to select all authors
>>> jselection(d).one("author", deep=True).tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien')JPath example:>>> from jpathpy import jpath, jselection
>>> d = { "books": [
    {"author": "Nigel Rees"},
    {"author": "Evelyn Waugh"},
    {"author": "Herman Melville"},
    {"author": "J. R. R. Tolkien"},
]}
>>> # try to select all authors by JPath
>>> jpath(r'$.."author"', jselection(d)).tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien')You can use multiline JPath expression. For example:>>> from jpathpy import jpath, jselection
>>> d = { "books": [
    {"author": "Nigel Rees"},
    {"author": "Evelyn Waugh"},
    {"author": "Herman Melville"},
    {"author": "J. R. R. Tolkien"},
]}
>>> # try to select all authors by JPath
>>> jpath(r'''$
               .."author"''', jselection(d)).tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien')Simple pythondictis not ordered, so that usingcollections.OrderedDictis more right if you work with JSON string. It saves initial order of items if you need it. For example:>>> import json
>>> from collections import OrderedDict
>>> from jpathpy import jselection
>>> strjson = '{"a":1, "b":2, "c":3, "d":4, "e":5}'
>>> d = json.loads(strjson)
>>> d
{'c': 3, 'a': 1, 'b': 2, 'd': 4, 'e': 5}
>>> # order of keys IS NOT EQUAL of initial order
>>> # in JSON string
>>> jselection(d).all().tuple()
(3, 1, 2, 4, 5)
>>> d = json.loads(strjson, object_pairs_hook=lambda x : OrderedDict(x))
>>> d
OrderedDict([('a', 1), ('b', 2), ('c', 3), ('d', 4), ('e', 5)])
>>> # order of keys IS EQUAL of initial order
>>> # in JSON string
>>> jselection(d).all().tuple()
(1, 2, 3, 4, 5)Version2.0.0Installpip install jpathpyUsage>>> from jpathpy import jselection
>>> d = { "books": [
            {"author": "Nigel Rees"},
            {"author": "Evelyn Waugh"},
            {"author": "Herman Melville"},
            {"author": "J. R. R. Tolkien"},
          ],
          "paintings": [
            {"author": "Leonardo Da Vinci"},
            {"author": "Edvard Munch"},
            {"author": "Sistine Chapel by Michelangelo"},
            {"author": "Vincent Van Gogh"},
          ]
}
>>> s = jselection(d)
>>> s.print()
({'books': [{'author': 'Nigel Rees'}, {'author': 'Evelyn Waugh'}, {'author': 'Herman Melville'}, {'author': 'J. R. R. Tolkien'}], 'paintings': [{'author': 'Leonardo Da Vinci'}, {'author': 'Edvard Munch'}, {'author': 'Sistine Chapel by Michelangelo'}, {'author': 'Vincent Van Gogh'}]},)Selection by keyUse simple selection for select all items with keybookson current level of nesting. If noone items are selected than empty selection will be got.>>> s.one("books").tuple()
([{'author': 'Nigel Rees'}, {'author': 'Evelyn Waugh'}, {'author': 'Herman Melville'}, {'author': 'J. R. R. Tolkien'}],)
>>> s.one("author").tuple()
()For select all authors use deep selection.>>> s.one("author", deep=True).tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien')Selection all keysFor select all items on current level of nesting use selection all keys.>>> s.all().tuple()
([{'author': 'Nigel Rees'}, {'author': 'Evelyn Waugh'}, {'author': 'Herman Melville'}, {'author': 'J. R. R. Tolkien'}], [{'author': 'Leonardo Da Vinci'}, {'author': 'Edvard Munch'}, {'author': 'Sistine Chapel by Michelangelo'}, {'author': 'Vincent Van Gogh'}])Also you can select all keys from all nested levels.>>> s.all(deep=True).tuple()
([{'author': 'Nigel Rees'}, {'author': 'Evelyn Waugh'}, {'author': 'Herman Melville'}, {'author': 'J. R. R. Tolkien'}], [{'author': 'Leonardo Da Vinci'}, {'author': 'Edvard Munch'}, {'author': 'Sistine Chapel by Michelangelo'}, {'author': 'Vincent Van Gogh'}], 'Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien', 'Leonardo Da Vinci', 'Edvard Munch', 'Sistine Chapel by Michelangelo', 'Vincent Van Gogh')Select items by indicesYou can select items by indices from selection. If index out of range no exceptions will be occured, but if index is invalid exception will be raised.>>> authors = s.one("books").one("author")
>>> authors.i(0).tuple()
('Nigel Rees',)
>>> authors.i(slice(None,None,-1)).tuple()
('J. R. R. Tolkien', 'Herman Melville', 'Evelyn Waugh', 'Nigel Rees')
>>> authors.i([1, 0, 3, 2]).tuple()
('Evelyn Waugh', 'Nigel Rees', 'J. R. R. Tolkien', 'Herman Melville')
>>> authors.i(100500).tuple()
()
>>> authors.i("0").tuple()
TypeError: indices must be integers or slices, not strSelection items from arraysYou can select items by indices from arrays if it exists in selection. If index out of range no exceptions will be occured, but if index is invalid exception will be raised. If item of selection is not array than it will be skiped in new selection.>>> authors = s.all()
>>> authors.el(0).tuple()
({'author': 'Nigel Rees'}, {'author': 'Leonardo Da Vinci'})
>>> authors.el(slice(None,None,-1)).tuple()
({'author': 'J. R. R. Tolkien'}, {'author': 'Herman Melville'}, {'author': 'Evelyn Waugh'}, {'author': 'Nigel Rees'}, {'author': 'Vincent Van Gogh'}, {'author': 'Sistine Chapel by Michelangelo'}, {'author': 'Edvard Munch'}, {'author': 'Leonardo Da Vinci'})
>>> authors.el([2,1]).tuple()
({'author': 'Herman Melville'}, {'author': 'Evelyn Waugh'}, {'author': 'Sistine Chapel by Michelangelo'}, {'author': 'Edvard Munch'})
>>> authors.el(100500).tuple()
()
>>> authors.el("0").tuple()
TypeError: indices must be integers or slices, not strExpand selection by array itemsIf you need to get all items in arrays as new selection you must expand selection. If you do this than all array in selection will be replaced to their items.>>> books = s.one("books")
>>> books.tuple()
([{'author': 'Nigel Rees'}, {'author': 'Evelyn Waugh'}, {'author': 'Herman Melville'}, {'author': 'J. R. R. Tolkien'}],)
>>> books.exp().tuple()
({'author': 'Nigel Rees'}, {'author': 'Evelyn Waugh'}, {'author': 'Herman Melville'}, {'author': 'J. R. R. Tolkien'})
>>> books.exp().tuple() == books.one("author").tuple()
FalseFilter selectionIf you need you can filter selection by using some function that must return value that can be represent as true or false. If this function return true for item in selection than item will be added to new selection and skipped in other case.All functions that used for filtering must have 3 positional arguments:idx. It will be contains index of current processed selection item.cur. It will be contains selection with only one item: current processed selection item.root. It will be contains root selection (root seelction can be get asselection.meta["root"]).If some exception will be occured while processing filtering function than it not be raised and item of selection will be skipped in new selection.>>> authors = s.one("author", deep=True)
>>> authors.tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien', 'Leonardo Da Vinci', 'Edvard Munch', 'Sistine Chapel by Michelangelo', 'Vincent Van Gogh')
>>> authors.filter(lambda idx, cur, root : cur[0].startswith("E")).tuple()
('Evelyn Waugh', 'Edvard Munch')
>>> # ("Nigel Rees")[12], ("Evelyn Waugh")[12] and ("Edvard Munch")[12] raise IndexError,
>>> # but it will be skipped
>>> authors.filter(lambda idx, cur, root : cur[0][12]).tuple()
('Herman Melville', 'J. R. R. Tolkien', 'Leonardo Da Vinci', 'Sistine Chapel by Michelangelo', 'Vincent Van Gogh')Call different functions on selectionYou can call your different functions on selection or on items in selection. Note, if some exception will be occured while processing function than exception be raised. Call of all following methods return value that return function, not selection.>>> authors = s.one("author", deep=True)
>>> authors.tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien', 'Leonardo Da Vinci', 'Edvard Munch', 'Sistine Chapel by Michelangelo', 'Vincent Van Gogh')
>>> # get first char of first item
>>> authors.i(0).call4item(0, str.__getitem__, 0)
'N'
>>> # get count of items
>>> authors.call4items(list.__len__)
8
>>> # call function on current selection
>>> authors.call4self(jselection.__class__.filter, lambda idx, cur, root : cur[0].startswith("E")).tuple()
('Evelyn Waugh', 'Edvard Munch')Also you can call function on each item in selection and get new selection. Note, in this case if some exception will be occured while processing function exception not be raised.>>> authors = s.one("author", deep=True)
>>> authors.tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien', 'Leonardo Da Vinci', 'Edvard Munch', 'Sistine Chapel by Michelangelo', 'Vincent Van Gogh')
>>> # get string length of each items
>>> authors.call4each(str.__len__).tuple()
(17, 12, 30, 16, 10, 12, 15, 16)Selection by JPathYou can use JPath syntax for select items.>>> from jpathpy import jpath
>>> s1 = jselection(d, jpath_inst=jpath)
>>> s1.byjpath(r'$.."author"').tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien', 'Leonardo Da Vinci', 'Edvard Munch', 'Sistine Chapel by Michelangelo', 'Vincent Van Gogh')Other capabilitiesIterate.>>> authors = s.one("books").one("author")
>>> authors.tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien')
>>> for a in authors:
            print(a)
Nigel Rees
Evelyn Waugh
Herman Melville
J. R. R. TolkienGet item by index.>>> authors[0]
'Nigel Rees'Add item.>>> (authors + ("Joan Rowling",)).tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien', 'Joan Rowling')Repeat items.>>> (authors.i(0) * 3).tuple()
('Nigel Rees', 'Nigel Rees', 'Nigel Rees')Get length of selection.>>> len(authors)
4As tuple.>>> authors.tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien')Print.>>> authors.print()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien')Meta data.>>> authors.meta
{'iters_by_idx': (<class 'collections.abc.Iterable'>,), 'root': <jpathpy.JSelection object at 0x02FF2670>, 'jpath_inst': None, 'iters_by_key': (<class 'dict'>,), 'ex_iters_by_idx': (<class 'dict'>, <class 'str'>), 'ex_iters_by_key': ()}Configurate process of selection.>>> s.one("author", deep=True).tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien', 'Leonardo Da Vinci', 'Edvard Munch', 'Sistine Chapel by Michelangelo', 'Vincent Van Gogh')
>>> d1 = { "books": [
            {"author": "Nigel Rees"},
            {"author": "Evelyn Waugh"},
            {"author": "Herman Melville"},
            {"author": "J. R. R. Tolkien"},
          ],
          "paintings": (
            OrderedDict({"author": "Leonardo Da Vinci"}),
            OrderedDict({"author": "Edvard Munch"}),
            OrderedDict({"author": "Sistine Chapel by Michelangelo"}),
            OrderedDict({"author": "Vincent Van Gogh"}),
          )
}
>>> # configurate selection
>>> s1 = jselection(d1, iters_by_idx=(list,), ex_iters_by_idx=(tuple,), iters_by_key=(dict,), ex_iters_by_key=(OrderedDict,))
>>> s1.one("author", deep=True).tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien')
>>>Use JPathJPath is string expression that has easy syntax and used for selecting items from objects, that can be iterate by keys or indices (such as dictionaries or lists).>>> from jpathpy import jpath, jselection
>>> d = { "books": [
            {"author": "Nigel Rees"},
            {"author": "Evelyn Waugh"},
            {"author": "Herman Melville"},
            {"author": "J. R. R. Tolkien"},
          ],
          "paintings": [
            {"author": "Leonardo Da Vinci"},
            {"author": "Edvard Munch"},
            {"author": "Sistine Chapel by Michelangelo"},
            {"author": "Vincent Van Gogh"},
          ]
}
>>> jpath(r'$.."author"', jselection(d)).tuple()
('Nigel Rees', 'Evelyn Waugh', 'Herman Melville', 'J. R. R. Tolkien', 'Leonardo Da Vinci', 'Edvard Munch', 'Sistine Chapel by Michelangelo', 'Vincent Van Gogh')JPath <-> JSelectionFollow table show how JPath expressions equal tojpathpy.JSelectionmethods.JPath expressionPythonCommentr’$’>>> rootroot selectionr’@’>>> curcurrent selectionr’$.”key”’>>> root.one("key")r’$..”key”’>>> root.one("key", deep=True)r’$.*’>>> root.all()r’$..*’>>> root.all(deep=True)r’$.[0]’>>> root.el(0)r’$.[0,1,2]’>>> root.el([0,1,2])r’$.[0:1]’>>> root.el(slice(0,1))r’$[0]’>>> root.i(0)r’$[0,1,2]’>>> root.i([0,1,2])r’$[0:1]’>>> root.i(slice(0,1))r’$[*]’>>> root.exp()r’$[@.”key”]’>>> root.filter(
>>>     lambda idx, cur, root :
>>>         cur.one("key")
>>> )r’$[@.”key” = “value”]’>>> root.filter(
>>>     lambda idx, cur, root :
>>>         cur.one("key")[0] == "value"
>>> )available compare operations:>,>=,<,<=,=,!=r’$[@.”key” + 1 > 3]’>>> root.filter(
>>>     lambda idx, cur, root :
>>>         cur.one("key")[0] + 1 > 3
>>> )available math operations:+,-,/,*,%r’$[@.”key” and $..”someKey”]’>>> root.filter(
>>>     lambda idx, cur, root :
>>>         cur.one("key") and root.one(
>>>             "someKey",
>>>             deep=True
>>>     )
>>> )available logic operations:and,orr’$[startswith(@, “value”)]’>>> root.call4self(
>>>     jpath_funcs.startswith, *("value",)
                                >>> )jpath_funcs is instance ofjpathpy.jpath_funcs.JPathFunctionsUse JPath functionsYou can call different functions from JPath expression. By default all new instances ofjpathpy.JPathuse instance ofjpathpy.jpath_funcs.JPathFunctions. This class provides methods that can be call as JPath function. For example:>>> jpath(r'$.."author"[startswith(@, "E")]', jselection(d)).tuple()
('Evelyn Waugh', 'Edvard Munch')You can define your classes, methods of which will be used as JPath functions. All that you need it is inherit from classjpathpy.jpath_funcs.JPathFunctionsWrapper. This class provides two protected methods:_jpath_function(func)It is decorator for decorate your methods as JPath function.First argument of JPath function must be an instance ofjpathpy.JSelection._getvalue(self, obj)Return value ofobjor value ofobj[0]ifobjis instance ofJSelection.Follow example show how define yourself JPath functions:>>> from jpathpy.jpath_funcs import JPathFunctionsWrapper
>>>
>>> class MyJPathFuncs(JPathFunctionsWrapper):
        @JPathFunctionsWrapper._jpath_function
        def firstchar(self, selection):
            return self._getvalue(selection)[0]
        @JPathFunctionsWrapper._jpath_function
        def lastchar(self, selection):
            return self._getvalue(selection)[-1]
>>>
>>>
>>> d = { "books": [
            {"author": "Nigel Rees"},
            {"author": "Evelyn Waugh"},
            {"author": "Herman Melville"},
            {"author": "J. R. R. Tolkien"},
          ],
          "paintings": [
            {"author": "Leonardo Da Vinci"},
            {"author": "Edvard Munch"},
            {"author": "Sistine Chapel by Michelangelo"},
            {"author": "Vincent Van Gogh"},
          ]
}
>>> jpath = JPath(jpath_funcs=MyJPathFuncs())
>>> s = jselection(d)
>>> author = jselection(d).one("author", deep=True).i(0)
>>> author.tuple()
('Leonardo Da Vinci',)
>>> jpath.exec_jpath_func(r'firstchar(@)', author, author)
'L'
>>> jpath.exec_jpath_func(r'lastchar(@)', author, author)
'i'
>>> jpath(r'$.."author"[firstchar(@) = "L" and lastchar(@) = "i"]', s).tuple()
('Leonardo Da Vinci',)Also you can inherit fromjpathpy.jpath_funcs.JPathFunctionsfor expand its functionality.