semvec/pypi-packages huggingface dataset:
redis2hdfs 0.0.2
Export Redis data to HDFS
License: MIT License
Keywords: redis hdfs

redis2hdfs
==========

redis2hdfs is a command line tool to help you export Redis data to HDFS.

NOTE: ensure WebHDFS is enabled.

Installation
------------

::

    $ pip install redis2hdfs

Usage
-----

::

    $ redis2hdfs --redis-key myzset --namenode-host namenode.example.com --hdfs-username hdfs --hdfs-path /tmp/myzset.lzo --compress-format lzo

redis2hdfs could compress file before copy to HDFS, through ``--compress-format`` option. Currently supported compress formats are: LZO.

If you want to use LZO format, you need install `lzop <http://www.lzop.org>`_ first.

Development
-----------

::

    $ mkvirtualenv redis2hdfs
    $ python setup.py develop