semvec/pypi-packages huggingface dataset:
gdom 1.0.0
DOM Traversing and Scraping using GraphQL
License: MIT
Keywords: scraping html graphql json

GDOM
====

GDOM is the next generation of web-parsing, powered by ``GraphQL``
syntax and the `Graphene framework <http://graphene-python.org>`__.

Install it typing in your console:

.. code:: bash

    pip install gdom

**DEMO**: `Try GDOM online <http://gdom.graphene-python.org/>`__

Usage
-----

You can either do ``gdom --test`` to start a test server for testing
queries or

.. code:: bash

    gdom QUERY_FILE

This command will write in the standard output (or other output if
specified via ``--output``) the resulting JSON.

Your ``QUERY_FILE`` could look similar to this:

.. code::

    {
      page(url:"http://news.ycombinator.com") {
        items: query(selector:"tr.athing") {
          rank: text(selector:"td span.rank")
          title: text(selector:"td.title a")
          sitebit: text(selector:"span.comhead a")
          url: attr(selector:"td.title a", name:"href")
          attrs: next {
             score: text(selector:"span.score")
             user: text(selector:"a:eq(0)")
             comments: text(selector:"a:eq(2)")
          }
        }
      }
    }

Advanced usage
--------------

If you want to generalize your gdom query to any page, just rewrite your
query file adding the ``$page`` var. So should look to something like
this:

.. code::

    query ($page: String) {
      page(url:$page) {
        # ...
      }
    }

And then, query it like:

.. code:: bash

    gdom QUERY_FILE http://news.ycombinator.com