semvec/pypi-packages huggingface dataset:
nocturne 0.0.6
Nocturne - utilities for Scalable Deep Learning with Spark, Horovod and Petastorm

Nocturne - utilities for Scalable Deep Learning with Spark, Horovod and Petastorm
=================================================================================

This repository contains useful elements and building blocks for scalable Deep Learning applications.

|build| |codecov| |black| |pypi|

.. |build| image:: https://img.shields.io/github/workflow/status/renardeinside/nocturne/CI%20pipeline/main?style=for-the-badge
    :alt: GitHub Workflow Status
    :target: https://github.com/renardeinside/dbx_scalable_dl/actions/workflows/onpush.yml

.. |pypi| image:: https://img.shields.io/pypi/v/nocturne.svg?style=for-the-badge
    :target: https://pypi.org/project/nocturne/
    :alt: Latest Python Release

.. |black| image:: https://img.shields.io/badge/code%20style-black-000000.svg?style=for-the-badge
    :target: https://github.com/psf/black
    :alt: We use black for formatting

.. |codecov| image:: https://img.shields.io/codecov/c/github/renardeinside/nocturne/main?style=for-the-badge&token=P9CiNFvruh
    :alt: Codecov branch
    :target: https://app.codecov.io/gh/renardeinside/nocturne


Dependencies
------------

The following libraries shall be installed before using :code:`nocturne`:

* JDK 1.8
* Apache Spark 3.x
* Tensorflow 2.x
* :code:`horovod[spark, tensorflow]`
* :code:`petastorm`

Since packaging of these dependencies might be challenging, you can use the base docker image with all dependencies provided in `Dockerfile.base`_.


To install the library, run:

.. code-block::

    pip install nocturne




Resources
---------

* `Horovod installation guide <https://horovod.readthedocs.io/en/stable/install_include.html>`_


.. _Dockerfile.base: docker/Dockerfile.base
pgcom 0.2.9
PostgreSQL communication manager
Requires Python: >=3.7

# pgcom

[![Build Status](https://travis-ci.org/viktorsapozhok/pgcom.svg?branch=master)](https://travis-ci.org/viktorsapozhok/pgcom)
[![pypi](https://img.shields.io/pypi/v/pgcom.svg)](https://pypi.python.org/pypi/pgcom)
[![Documentation Status](https://readthedocs.org/projects/pgcom/badge/?version=latest)](https://pgcom.readthedocs.io/en/latest/?badge=latest)
[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](https://opensource.org/licenses/MIT)
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)


Communication manager for PostgreSQL database, provides a collection of convenience
wrappers over Psycopg adapter to simplify the usage of basic Psycopg methods in conjunction
with Pandas DataFrames.

## Installation

To install the package, simply use pip:

```
$ pip install pgcom
```

## Key features

* Reading from database table to Pandas DataFrame. 
* Writing from DataFrame to a table.
* Adaptation between DataFrames and COPY FROM.
* Methods to resolve conflicts in DataFrame before applying COPY FROM.
* Tools for setting asynchronous communication with database using LISTEN and NOTIFY commands.

Read the [documentation](https://pgcom.readthedocs.io/en/latest/) for more.

## License

MIT License (see [LICENSE](LICENSE)).