semvec/pypi-packages huggingface dataset:
exparso 0.0.3
Analyzing and parsing documents
Requires Python: >=3.10
Keywords: langchain, openai, openpyxl, pdf, pdfplumber, pillow

# 📑 Exparso

![python](https://img.shields.io/badge/python-%20%203.10%20|%203.11%20|%203.12-blue)

本ライブラリは、画像を含むドキュメントのパースを行うためのライブラリです。
テキストとして出力することで、従来のベクトル検索や全文検索での利用を可能することを目的とします。
[](<より詳しい情報に関しては、[こちら](https://congenial-waddle-5krzvq6.pages.github.io/)を参照してください。>)

## 📥 インストール方法

### LibreOffice

Office ファイルをテキストに変換するために、LibreOffice をインストールします。

```bash
# Ubuntu
sudo apt install libreoffice

# Mac
brew install --cask libreoffice
```

### ライブラリのインストール

```bash
pip install exparso
```

## 💡 使用方法

`parse_document` 関数を利用して、ドキュメントをパースします。

```python
from exparso import parse_document
from langchain_openai import AzureChatOpenAI

llm_model = AzureChatOpenAI(model="gpt-4o")
text = parse_document(path="path/to/document.pdf", model=llm_model)
```

## 📑 対応ファイル

| コンテンツタイプ      | 拡張子                     |
| --------------------- | -------------------------- |
| **📑 ドキュメント**   | PDF, PowerPoint            |
| **🖼️ 画像**           | JPEG, PNG, BMP             |
| **📝 テキストデータ** | テキストファイル, Markdown |
| **📊 表データ**       | Excel, CSV                 |

## 🔥 LLM

| クラウドベンダー | モデル                                                                                                              |
| ---------------- | ------------------------------------------------------------------------------------------------------------------- |
| Azure            | ChatGPT(`gpt-4o`, `gpt-4o-mini`)                                                                                    |
| Google Cloud     | Claude(`claude-3.7-sonnet`,`claude-3.5-sonnet`), Gemini(`gemini-2.0-flash`,`gemini-1.5-flash-*`,`gemini-2.0-pro-*`) |
uffutils 0.6.0
A set of commandline tools for manipulating UFF files.
Requires Python: >=3.11

# UFFUtils

A Python-based command-line tool for manipulating UFF datasets.

[![PyPI version](https://badge.fury.io/py/uffutils.svg)](https://pypi.org/project/uffutils/)
[![PyPi status](https://img.shields.io/pypi/status/uffutils)](https://pypi.org/project/uffutils/)
![Release date](https://img.shields.io/github/release-date-pre/janheindejong/uffutils)
![Python Package CI](https://github.com/janheindejong/uffutils/actions/workflows/python-package.yml/badge.svg?branch=main)
![Monthly downloads](https://img.shields.io/pypi/dm/uffutils)
![License](https://img.shields.io/pypi/l/uffutils)
![Python versions](https://img.shields.io/pypi/pyversions/uffutils)

## Introduction

UFFUtils lets you inspect and manipulate UFF files. Let's look at an example.

Say you have some dataset - `my_data.uff` - that you want to reduce in size (e.g., by only taking every 1000th node), scale from mm to m, rotate around the y-axis by 90 degrees. With UFFUtils, you would do this in the following way:

```powershell
uffutils subset my_data.uff --step 1000 `
uffutils scale --length 0.001 `
uffutils rotate - rotated.uff --angles 0 90 0
```

Congratulations! You now have a reduced, scaled and rotated version of your dataset!

For more functionality, see the description of each command below.

## Installing

A good way to run UFF utils is through [`uv`](https://docs.astral.sh/uv/getting-started/installation/). Once you have installed `uv`, you can run `uffutils` like so:

```powershell
uvx uffutils
```

No need for any additional software (e.g., Python); `uv` handles it for you.

## Usage

### The `inspect` command

The `inspect` command allows you to view the contents of a UFF file. Example usage:

```powershell
uffutils inspect my_file.uff  # Print nice overview 
uffutils inspect my_file.uff --nodes # Print full list of nodes
```

### The `subset` command

Allows you to create file with a subset of nodes, which is particularly useful if you want to downsize a UFF file. Usage:

```powershell
uffutils subset input.uff output.uff --ids "1,2,3"  # Only takes nodes 1, 2 and 3
uffutils subset input.uff output.uff --step 1000  # Takes every 1000th node, starting at 1 
uffutils subset input.uff output.uff --max 100 # Takes the first 100 nodes 
```

Operations can be combined. The following operation yields a file with nodes 10 and 30.

```powershell
uffutils subset input.uff output.uff --selection "10,20,30,40,50" --step 2 --max 2
```

### The `scale` command  

You can scale length:

```powershell
uffutils scale input.uff output.uff --length 1000 
```

### The `translate` command

You can translate the data:

```powershell
uffutils translate input.uff output.uff --xyz 10.0 20.0 30.0 
```

### The `rotate` command

You can rotate the data:

```powershell
uffutils rotate input.uff output.uff --angles 90 90 90
```

### Combining commands

You can combine commands through piping, like so:

```powershell
uffutils subset input.uff --step 100 | `
    uffutils scale --length 1000 | `
    uffutils move --xyz 10 20 30 | `
    uffutils rotate - output.uff --xyz 90 0 0 
```
mp-explore-source-nrw 0.1.0
Obtain data of North Rine-Westphalia MPs
Requires Python: >=3.11

<!--
SPDX-FileCopyrightText: 2025 Free Software Foundation Europe e.V. <mp-explore@fsfe.org>

SPDX-License-Identifier: AGPL-3.0-or-later
-->

# MP Explore Nordrhein-Westfalen

Part of the [MP Explore](https://git.fsfe.org/mp-explore/mp-explore) project.

Data Source for the Nordrhein-Westfalen parliament.

## Where to get it

You can get it through the [Python Package Index (PyPI)](https://pypi.org/project/mp_explore_core/):

```sh
$ pip3 install mp_explore_source_nrw
```

## Arguments

- (Optional) `display_browser` When enabled, a browser window is opened displaying the actions being performed.
- (Optional) `url` URL from where the data is extracted
- (Optional) `retrieve_emails` When enabled, e-mails will be retrieved. This takes a long time.
mp-explore-source-aarhus 0.1.0
Obtain data of the Aarhus City Council
Requires Python: >=3.11

<!--
SPDX-FileCopyrightText: 2025 Free Software Foundation Europe e.V. <mp-explore@fsfe.org>

SPDX-License-Identifier: AGPL-3.0-or-later
-->

# MP Explore Aarhus

Part of the [MP Explore](https://git.fsfe.org/mp-explore/mp-explore) project.

Data Source for the Aarhus city council.

## Where to get it

You can get it through the [Python Package Index (PyPI)](https://pypi.org/project/mp_explore_source_aarhus/):

```sh
$ pip3 install mp_explore_source_aarhus
```

## Arguments

- (Optional) `display_browser` When enabled, a browser window is opened displaying the actions being performed.
- (Optional) `url` URL from where the data is extracted
mp-explore-export-sqlite 0.1.1
Export data as SQLite
Requires Python: >=3.11

<!--
SPDX-FileCopyrightText: 2025 Free Software Foundation Europe e.V. <mp-explore@fsfe.org>

SPDX-License-Identifier: AGPL-3.0-or-later
-->

# MP Explore Export SQLite

Part of the [MP Explore](https://git.fsfe.org/mp-explore/mp-explore) project.

Data Consumer to export data in SQLite

## Where to get it

You can get it through the [Python Package Index (PyPI)](https://pypi.org/project/mp_explore_core/):

```sh
$ pip3 install mp_explore_export_sqlite
```

## Arguments

- `dest` Where the SQLite database is (or will be) stored.
- (Optional) `track_changes` When enabled, instead of overwritting the existing tables, new tables will be created. These new tables define the data as was at a certain point in time. References to these tables and when were they created will be stored in a `time_mappings` table.
- (Optional) `table_name` Where will the data be stored
- (Optional) `separate_sources` When enabled, each data source will have its own table
- (Optional) `overwrite` If the database already exists, overwrite all of the contents
mp-explore-export-csv 0.1.0
Export data as CSV
Requires Python: >=3.11

<!--
SPDX-FileCopyrightText: 2025 Free Software Foundation Europe e.V. <mp-explore@fsfe.org>

SPDX-License-Identifier: AGPL-3.0-or-later
-->

# MP Explore Export CSV

Part of the [MP Explore](https://git.fsfe.org/mp-explore/mp-explore) project.

Data Consumer to export data in CSV

## Where to get it

You can get it through the [Python Package Index (PyPI)](https://pypi.org/project/mp_explore_core/):

```sh
$ pip3 install mp_explore_export_csv
```

## Arguments

- `dest` Where will the CSV file be stored.
- (Optional) `index` When enabled, the index will be kept.
julia-incidents 0.1.1
A Django app to work with incidents API.
Requires Python: >=3.12

# julia-incidents

**Package Django réutilisable** développé par CITY UP pour intéragir avec le service des incidents (API Rest).

## ⚠️ Requirements

- The main project must have a configured storage backend for the media files
  like [MinIO](https://min.io/open-source/download?platform=docker), with a bucket. Example :
    ```python
    STORAGES = {
        "default": {
            "BACKEND": "storages.backends.s3.S3Storage",
            "OPTIONS": {
                "bucket_name": os.environ.get(
                    "MINIO_BUCKET_MEDIAS", "julia-incidents-medias"
                )
            },
        },
        "staticfiles": {
            "BACKEND": "django.contrib.staticfiles.storage.StaticFilesStorage",
        },
    }
    AWS_ACCESS_KEY_ID = os.environ.get("AWS_ACCESS_KEY_ID", "minioadmin")
    AWS_SECRET_ACCESS_KEY = os.environ.get("AWS_SECRET_ACCESS_KEY", "minioadmin")
    AWS_S3_ENDPOINT_URL = os.environ.get("AWS_S3_ENDPOINT_URL", "http://minio:9000")
    ```

## 🚀 Quick start

1. Run `pip install git+https://git.cityup.mq/city8492901/jul-ia-packages/julia-incidends.git@main` to install the
   package.

2. Add "julia_incidents" and its dependencies to your INSTALLED_APPS setting like this:

        INSTALLED_APPS = [
            ...,
            "julia_incidents",
        ]

3. Add a cache backend to your settings like this (In Memory or
   setup [Redis](https://docs.djangoproject.com/fr/5.2/topics/cache/#redis)):
    ```python
    CACHES = {
        ...
        "incidents-data": {
            "BACKEND": "django.core.cache.backends.locmem.LocMemCache",
            "LOCATION": "julia-incidents",
        },
    }
    ```
4. Set up the API url & bearer token in your settings like this:
    ```python
    JULIA_INCIDENTS_API_URL = os.environ.get("JULIA_INCIDENTS_API_URL", "https://cupco-julia-incidents.cityup.mq/")
    JULIA_INCIDENTS_API_TOKEN = os.environ.get( "JULIA_INCIDENTS_API_TOKEN", "your_api_token_here")
    ```

5. Include the julia_incidents URLconf in your project urls.py like this:

        urlpath("incidents/", include("julia_incidents.urls", namespace="incidents")),

6. Start the development server and visit the admin to explore the models.

7. Visit the `/incidents/` URL .

## 🧪 Tests

Run tests with `./intox.sh`

## 📖 Docs

To generate the docs, run:

```python
pip install -r docs/requirements.txt
cd docs && make html
```

Results are in the `docs/_build/html` directory.

## 🪪 Licence usage interne

Ce package est fourni pour un usage interne uniquement.
Tous droits réservés – Département Développement et Innovation.

## ✉️ Contact

**Développeur** : Bastien

**Email** : `b.launay@tx-studio.com`