semvec/pypi-packages huggingface dataset:
lab-etl 0.0.1
ETL system for interpreting laboratory instrument data files and loading them into a standardized format while enforcing schema and retaining all metadata.
Requires Python: >=3.8

# lab-etl

[![PyPI - Version](https://img.shields.io/pypi/v/lab-etl.svg)](https://pypi.org/project/lab-etl)
[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/lab-etl.svg)](https://pypi.org/project/lab-etl)

This repository contains the codebase for the ETL scripts for loading laboratory instrument data files into our database. In particular, data files from a variety of formats are converted to Apache Parquet files which provides a standardized interface for access and enforces schema. Of notable importance is the inclusion of metadata in these files. Metadata is extracted from the original test files and stored as JSON-like metadata within the Parquet files in either file-wide or column-specific, as appropriate. Depending on the type of file (from which type of instrument) the keys will be standardized for common fields. Additional metadata that may be instrument-specific will be stored as additional metadata but is not guaranteed to be standardized in any meaningful way. However, the names of these fields may be slightly altered to provide clarity to the user as to what they might represent.

Development currently focuses on files and instruments of interest to FSRI's Materials Properties Laboratory but as we integrate with external stakeholders, or have the time, additional instruments and filetypes will be added. Feel free to reach out if you have a particular need for some capability or submit a PR.

---

## Table of Contents

- [Installation](#installation)
- [License](#license)

## Installation

```console
pip install lab-etl
```

## License

`lab-etl` is distributed under the terms of the [MIT](https://spdx.org/licenses/MIT.html) license.
programs-integrator 0.3
Daemon program for dynamically generating 'Programs' directory

# Programs Integrator
Programs integrator is a GNU/Linux daemon program, written in python, dynamicly generating "Programs" directory in user's home directory. It scans all XDG_DATA_DIRS periodically and makes symbolic links inside the managed directory to application desktop entries.

#### systemd
Program is running as user systemd service. User session with graphical environment is required to run and manage the program.

#### programs-integrator-ctl
It starts graphical tool managing configuration of the program. The configuration is stored in "~/.config/programs-integrator" directory. It let's you change settings, list destkop entries excluded from linking and provides you with information about XDG_DATA_DIRS.
![screenshot](https://raw.githubusercontent.com/artudi54/programs-integrator/master/Programs%20Integrator%20Configuration.png)

## Installation
Application supports only user install. System wide installation won't work, as this app serves as user-only service.

#### Installing package

##### Installing with PIP
programs-integrator is avalable as a PyPI package. It can be downloaded and installed with PIP
```bash
pip install --user programs-integrator
```

##### Manual installation
Installing program manually is not recommended, as application is not managed by any package manager. Manual installation can be done with "setup.py" script using setuputils package.
```bash
git clone https://github.com/artudi54/programs-integrator
cd programs-integrator
./setup.py install --single-version-externally-managed
```

#### Registering systemd service
To start the service it is required to enable systemd user service
```bash
systemctl --user daemon-reload
systemctl --user enable programs-integrator.service
systemctl --user start programs-integrator.service
```