semvec/pypi-packages huggingface dataset:
cmem-plugin-splitfile 1.1.0
Split a text file into parts of the same filesize
License: Apache-2.0
Requires Python: <4.0,>=3.13
Keywords: eccenca Corporate Memory, plugin

# cmem-plugin-splitfile

Split a text file into parts with a specified size.

[![eccenca Corporate Memory][cmem-shield]][cmem-link]

This is a plugin for [eccenca](https://eccenca.com) [Corporate Memory](https://documentation.eccenca.com). You can install it with the [cmemc](https://eccenca.com/go/cmemc) command line client like this:

```
cmemc admin workspace python install cmem-plugin-splitfile
```

## Parameters

### Input filename

The input file to be split.  
_Example:_ An input file with the name _input.nt_ will be split into files with the names _input\_000000001.nt_,
_input\_000000002.nt_,   _input\_000000003.nt_, etc.  
⚠️ Existing files will be overwritten!

### Chunk size

The maximum size of the chunk files.

### Size unit

The unit of the size value: kilobyte (KB), megabyte (MB), gigabyte (GB), or number of lines (Lines).

### Include header

Include the header in each split. The first line of the input file is treated as the header.

### Delete input file

Delete the input file after splitting.

### Use internal projects directory

Use the internal projects directory of DataIntegration to fetch and store files, instead of using the API.
If enabled, the "Internal projects directory" parameter has to be set.

### Internal projects directory

The path to the internal projects directory. If "Use internal projects directory" is disabled,
this parameter has no effect.


[![workflow](https://github.com/eccenca/cmem-plugin-splitfile/actions/workflows/check.yml/badge.svg)](https://github.com/eccenca/cmem-plugin-splitfile/actions) [![pypi version](https://img.shields.io/pypi/v/cmem-plugin-splitfile)](https://pypi.org/project/cmem-plugin-splitfile) [![license](https://img.shields.io/pypi/l/cmem-plugin-splitfile)](https://pypi.org/project/cmem-plugin-splitfile)
[![poetry][poetry-shield]][poetry-link] [![ruff][ruff-shield]][ruff-link] [![mypy][mypy-shield]][mypy-link] [![copier][copier-shield]][copier] 

[cmem-link]: https://documentation.eccenca.com
[cmem-shield]: https://img.shields.io/endpoint?url=https://dev.documentation.eccenca.com/badge.json
[poetry-link]: https://python-poetry.org/
[poetry-shield]: https://img.shields.io/endpoint?url=https://python-poetry.org/badge/v0.json
[ruff-link]: https://docs.astral.sh/ruff/
[ruff-shield]: https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json&label=Code%20Style
[mypy-link]: https://mypy-lang.org/
[mypy-shield]: https://www.mypy-lang.org/static/mypy_badge.svg
[copier]: https://copier.readthedocs.io/
[copier-shield]: https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/copier-org/copier/master/img/badge/badge-grayscale-inverted-border-purple.json