semvec/pypi-packages huggingface dataset:
dxtrx 0.0.8
Dagster extra utilities for data processing
License: MIT
Requires Python: >=3.11.8

# Dxtr Dagster Library

A Python library that provides utilities and components for data engineering workflows using Dagster. The library focuses on data processing capabilities including downloading data from Sharepoint, loading to PostgreSQL, and performing data transformations.

## Project Structure

The library is organized into the following components:

```
dxtr/
├── dxtr/     # Main library package
│   ├── dagster/          # Dagster-specific components and resources
│   └── utils/            # Utility functions
├── pyproject.toml        # Project configuration and dependencies
└── README.md            # This file
```

## Features

- Sharepoint data file downloading
- SQLAlchemy data loading
- Data transformation capabilities
- Integration with Dagster for workflow orchestration

## Dependencies

The library requires Python 3.11.8 or higher and includes key dependencies such as:
- polars
- google-cloud-storage
- requests
- msal
- pandas
- sqlalchemy
- psycopg2-binary
- and more (see pyproject.toml for complete list)

## Development

### Installation

For development purposes, install the package in editable mode:
```bash
pip install -e ".[dev] --config-settings editable_mode=compat"
```

Please refer to the Wiki to usage of `./dxtrx.sh` to setup the environment and start the Dagster code server a more convenient way of working with this code.

The library requires several environment variables to be set:
- Sharepoint credentials
- Database credentials
- Other configuration variables

Please refer to the Wiki for detailed setup instructions using `./dxtrx.sh` to configure the environment and start the Dagster code server.

### Contributing Guidelines

When contributing to this library:
1. Follow the existing code structure and naming conventions
2. Add new components in the appropriate directories
3. Update documentation as needed
4. Test changes locally
5. Submit PRs with evidence of testing and team review

#### Running tests

To run the tests, use the following command:
```bash
pytest
```

Or you can also run them in watching mode:
```bash
ptw
```
canify 0.1.0
下一代知识密集型项目的协作基石，将文档即代码的理念推广到所有行业
License: MIT
Requires Python: >=3.13

# Canify

下一代知识密集型项目的协作基石，将文档即代码的理念推广到所有行业

## 简介

Canify 是一个强大的结构化文档验证系统，将软件工程中的质量保证体系引入到文档协作中。

## 功能特性

- 多阶段验证引擎
- 实体声明和引用解析
- Git 集成和元数据恢复
- 智能缓存系统

## 快速开始

```bash
# 安装依赖
uv sync

# 运行验证
canify verify demo/
```

## 文档

详细文档请参考 `docs/` 目录。

## 许可证

MIT License
wordstats 1.1.0
Multilingual word frequency statistics for Python based on subtitles corpora
License: MIT
Keywords: natural language processing, multilingual


Statistics about word frequencies in different languages based on a corpus of 
movie subtitles as extracted by the Frequency Words (https://github.com/hermitdave/FrequencyWords) project.

Currently supported languages (or language codes to be more precise :): 

    "da", "de", "el", "en", "es", "fr", "it", "nl", "no", "pl", "pt", "ro", "zh-CN" 


### Usage Examples


##### Getting the info about a given word 

    >> from wordstats import Word
    >> print (Word.stats('bleu', 'fr'))
    bleu: (lang: fr, rank: 1521, freq: 9.42, imp: 9.42, diff: 0.03, klevel: 2)
    

##### Comparing the difficulty of two German words

    >> from wordstats import Word
    >> Word.stats('blauzungekrankenheit','de').difficulty > Word.stats('blau','de').difficulty
    True
    
    
##### Top 10 most used words in Dutch

    >> from wordstats import LanguageInfo
    >> Dutch = LanguageInfo.load('nl')
    >> print(Dutch.all_words()[:10])
    ['ik', 'je', 'het', 'de', 'dat', 'is', 'een', 'niet', 'en', 'van']

##### Words common across all the languages

Given that the corpus is based on subtitles, some common names have sliped in.
The `common_words()` function returns a list.

    >> from wordstats.common_words import common_words
    >> for each in common_words():
    >>     if len(each) > 9:
    >>         print(each)
    washington
    christopher
    enterprise


##### Words that are the same in Polish and Romanian

    >> from wordstats import LanguageInfo
    >> Polish = LanguageInfo.load("pl")
    >> Romanian = LanguageInfo.load("ro")
    >> for each in Polish.all_words():
    >>     if each in Romanian.all_words():
    >>         if len(each) > 5 and each not in common_words():
    >>             print(each)
    telefon
    moment
    prezent
    interes
    ...


### Installation

    pip install wordstats