semvec/pypi-packages huggingface dataset:
pncpy 0.0.3
Provides an object-oriented python interface to the PnetCDF library
License: MIT
Requires Python: >=3.9
Keywords: numpy,netcdf,data,science,network,oceanography,meteorology,climate

PnetCDF-python is a Python interface to PnetCDF, a high-performance parallel I/O
 library for accessing netCDF files. This integration with Python allows for easy
  manipulation, analysis, and visualization of netCDF data using the rich ecosystem
   of Python's scientific computing libraries, making it a valuable tool for python-based
    applications that require high-performance access to netCDF files.
tkn 0.1.2
A command-line utility for working with BPE tokenizers
License: MIT
Requires Python: >=3.10,<3.13

# `tkn`

`tkn` is a command-line utility to quickly tokenize with `tiktoken`.

## Installation

`pip install tkn`

Example usage:

```
$ ls
document_1.txt
document_2.txt

$ tkn document_1.txt
[tokenized version of the data]

$ tkn document_1.txt -s '\n' | wc -l
2094 # document contains 2094 tokens

$ tkn -m gpt-4 document_1.txt | tkn -m gpt-4 -d
[the contents of document_1.txt]