malcolm3utils 0.6.0
Collection of Utility Scripts and Packages
License: BSD-3-Clause
Requires Python: <4.0,>=3.11

# Malcolm3Utils

[![PyPI](https://img.shields.io/pypi/v/malcolm3utils?style=flat-square)](https://pypi.python.org/pypi/malcolm3utils/)
[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/malcolm3utils?style=flat-square)](https://pypi.python.org/pypi/malcolm3utils/)
[![PyPI - License](https://img.shields.io/pypi/l/malcolm3utils?style=flat-square)](https://pypi.python.org/pypi/malcolm3utils/)
[![Coookiecutter - Wolt](https://img.shields.io/badge/cookiecutter-Wolt-00c2e8?style=flat-square&logo=cookiecutter&logoColor=D4AA00&link=https://github.com/woltapp/wolt-python-package-cookiecutter)](https://github.com/woltapp/wolt-python-package-cookiecutter)


---

**Documentation**: [https://malcolm-3.github.io/malcolm3utils](https://malcolm-3.github.io/malcolm3utils)

**Source Code**: [https://github.com/malcolm-3/malcolm3utils](https://github.com/malcolm-3/malcolm3utils)

**PyPI**: [https://pypi.org/project/malcolm3utils/](https://pypi.org/project/malcolm3utils/)

---

Collection of Utility Scripts and Packages

## Installation

```sh
pip install malcolm3utils
```

## Usage

This package provides the following command line tools

- ``touch_latest``
  - This touches a marker file with the timestamp of the most recently changed file under the specified directories
- ``getcol``
  - A tool for extracting columns of data by column header name or column id
- ``merge``
  - A version of the ``join`` command that doesn't require pre-sorting
- ``filter``
  - Filter csv files using expressions containing the column headers

## Development

* Clone this repository
* Requirements:
  * [Poetry](https://python-poetry.org/)
  * Python 3.9+
* Create a virtual environment and install the dependencies

```sh
poetry install
```

* Activate the virtual environment

```sh
poetry shell
```

### Testing

```sh
pytest
```

### Documentation

The documentation is automatically generated from the content of the `docs` directory and from the docstrings
 of the public signatures of the source code. The documentation is updated and published as a [Github project page
 ](https://pages.github.com/) automatically as part each release.

### Releasing

Trigger the [Draft release workflow](https://github.com/malcolm-3/malcolm3utils/actions/workflows/draft_release.yml)
(press _Run workflow_). This will update the changelog & version and create a GitHub release which is in _Draft_ state.

Find the draft release from the
[GitHub releases](https://github.com/malcolm-3/malcolm3utils/releases) and publish it. When
 a release is published, it'll trigger [release](https://github.com/malcolm-3/malcolm3utils/blob/master/.github/workflows/release.yml) workflow which creates PyPI
 release and deploys updated documentation.

### Pre-commit

Pre-commit hooks run all the auto-formatters (e.g. `black`, `isort`), linters (e.g. `mypy`, `flake8`), and other quality
 checks to make sure the changeset is in good shape before a commit/push happens.

You can install the hooks with (runs for each commit):

```sh
pre-commit install
```

Or if you want them to run only for each push:

```sh
pre-commit install -t pre-push
```

Or if you want e.g. want to run all checks manually for all files:

```sh
pre-commit run --all-files
```

---

This project was generated using the [python-package-cookiecutter](https://github.com/collijk/python-package-cookiecutter) template.