semvec/pypi-packages huggingface dataset:
matchescu-reference-store 0.8.5
Entity reference storage data types and APIs
License: MIT
Requires Python: !=2.7.*,!=3.0.*,!=3.1.*,!=3.10.*,!=3.11.*,!=3.12.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,!=3.8.*,!=3.9.*,>=3.13

# Reference Store

The entity reference store's main job is to keep entity references known by the system.
Depending on the entity resolution model being used, it may persist relations between
entity references.

The entity reference store logically organizes the data it stores in workspaces.
Each workspace corresponds to an entity resolution problem domain. For example,
users might have one workspace for resolving publications across multiple data sources
and another workspace for resolving e-commerce products across vendor databases.

# Development

First, ensure that the package builds locally and that the automated test suite runs
fine.

```shell
$ make bootstrap
$ make test
```

Then follow the coding guidelines to submit new contributions.

# Usage

This package is meant to be used as a subsystem in a larger entity resolution pipeline.
The functionalities should be imported and used as per the pipeline's requirements.
matchescu-reference-extraction 0.8.0
Extract references from a multitude of data sources
License: MIT
Requires Python: !=2.7.*,!=3.0.*,!=3.1.*,!=3.10.*,!=3.11.*,!=3.12.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,!=3.8.*,!=3.9.*,>=3.13

from matchescu.data_sources import CsvDataSource

# matchescu-reference-extraction

This package implements an entity reference extraction subsystem for entity
resolution.
The main concepts that are relevant here are:

* a generic attribute-based data record implementation (can access data by `str`
or `int` key),
* various `data_sources` which support reading records from different data
stores, and
* generic `extraction_engines` that convert data records to entity references.

# Development

Run the following commands to ensure you have a proper environment.

```shell
$ pyenv install 3.12
$ poetry install
$ poetry run pytest
```

When you contribute code, open a new `feature/*` or `hotfix/*` branch.

# Usage

```python
from matchescu.data_sources import CsvDataSource
from matchescu.extraction import Traits

traits = list(
    Traits().int(["id"])
    .string(["name", "description", "manufacturer"])
    .currency(["price"])
)
csv = CsvDataSource("./path/to/csv/file", list(traits))

```