semvec/pypi-packages huggingface dataset:
data-parser 0.0.3
Data parser to parse newline delimited logs into tabular format.
Requires Python: >=3

# Parse raw logs to tabular format
This package helps to parse new line delimited logs to tabular formats. The user provides the regex, file path and column names, and a dataframe will be returned.  
Depending on the supplied mode (local/spark), a pandas dataframe or a spark dataframe will be returned.

## Features
### Local mode
1. Regex matching is done using multiprocessing.
1. Glob searching for files.
1. Lazy evaluation of files. This allows larger than memory datasets to be parsed, but note that upon parsing, the resultant pandas dataframe must be able to fit in memory.

## Installation
### Purely for local usage (No pyspark)
pip install data-parser
### Both local and pyspark
pip install data-parser[pyspark]

## Usage - Local (Pandas)
```python
from data_parser import DataSource

# Bind 9: Feb  5 09:12:11 ns1 named[80090]: client 192.168.10.12#3261: query: www.server.example IN A
dns = DataSource(
    path='/path/to/dnsdir/*.txt',  # Glob patterns supported
    mode='local'
)

# Pandas dataframe is returned
dns_df = dns.parse(
    regex='^([A-Z][a-z]{2})\s+(\d+) (\d{2}\:\d{2}\:\d{2}) (\S+).+client ([^\s#]+)#(\d+)',
    col_names=['month', 'day', 'time', 'nameserver', 'query_ip', 'port'],
    on_error='raise'
)
```

## Usage - Spark (Pyspark)
```python
from data_parser import DataSource

# Bind 9: Feb  5 09:12:11 ns1 named[80090]: client 192.168.10.12#3261: query: www.server.example IN A
dns = DataSource(
    path='/path/to/dns/log',
    mode='spark'
)

# Spark dataframe is returned
dns_df = dns.parse(
    regex='^([A-Z][a-z]{2})\s+(\d+) (\d{2}\:\d{2}\:\d{2}) (\S+).+client ([^\s#]+)#(\d+)',
    col_names=['month', 'day', 'time', 'nameserver', 'query_ip', 'port'],
    on_error='raise'
)
```
ipv4helper 0.9.1
Handle and manipulate IPv4 CIDRs in a simple fashion, including generating CIDR ranges and viewing general subnet information.

# IPv4Helper
Handle and manipulate IPv4 CIDRs in a simple fashion, including generating CIDR ranges and viewing general subnet information.

### Installation
```
pip install ipv4helper
```

### Usage
Provide an IPv4 address, and optionally the CIDR it resides in (otherwise "/32" will be appended to the given IP).
```
from ipv4helper import IPv4Helper
i = IPv4Helper("127.144.4.9/28")
print(i.subnet_summary)
for x in i.ip_range_generator():
	print(x)

# snipped output
# ...
# 127.144.4.9/28
# CIDR                    28
# Mask                    255.255.255.240
# Binary Mask             11110000
# Range                   127.144.4.0 - 127.144.4.15
# Blocksize               16
# Subnet Addresses        16
# Usable Addresses        14
# ACL Wildcard            0.0.0.15
# Octet Incremented       4
# Octet Masked            1
# ...
# 127.144.4.0
# 127.144.4.1
# 127.144.4.2
# 127.144.4.3
# 127.144.4.4
# ...
```

### Available Attributes
```
blocksize
cidr
given_ip
given_cidr
given_ip_first_octet
given_ip_second_octet
given_ip_third_octet
given_ip_fourth_octet
iparg
mask
mask_binary
octet # position to be incremented
mask_octet # position to be masked
subnets # dictionary of general subnet information
subnet_summary
subnet_addresses
usable_addresses
subnet_info # dictionary
subnet_json # json
subnet_min_ip
subnet_max_ip
subnet_max_octet
subnet_min_octet
wildcard
```

### Available Generator Functions
```
octet_generator()
ip_range_generator()
```

### Integration with IPv4Mutate [GitHub](https://github.com/bonifield/IPv4Mutate) [PyPi](https://pypi.org/project/ipv4mutate/)
```
from ipv4helper import IPv4Helper
from ipv4mutate import IPv4Mutate
i = IPv4Helper("127.144.4.9/28")
for x in i.ip_range_generator():
	z = IPv4Mutate(x)
	print(z.mutate_hex)

# snipped output
# ...
# 0x7f.0x90.0x4.0x0
# 0x7f.0x90.0x4.0x1
# 0x7f.0x90.0x4.0x2
# 0x7f.0x90.0x4.0x3
# ...
```

### Important Notes
- "/0" is not supported in this version, but it will be "soon"

### TODO
- better internal naming convention
- /0 support
- integrate with IPv4Mutate and IPv6Helper
tdk-sozluk 1.0.4
En iyi TDK sözlük arama kütüphanesi. Best TDK dict. search library.
Requires Python: >=3.3

# TDK-Sözlük
En iyi TDK sözlük arama kütüphanesi.\
Best TDK dict. search library.
 
### Yükleme / Install:
```shell
$ pip install tdk-sozluk
```

### Gereksinimler / Requirements:
Python 3.3+\
pip

### Temel Kullanım / Basic Usage
```python
import tdk
sonuclar = tdk.ara("yüzmek")
for s in sonuclar:
    for i in s.anlamlar():
        print(i.anlam())
```
Output / Çıktı:
```
Kol, bacak, yüzgeç vb. organların özel hareketleriyle su yüzeyinde veya su içinde ilerlemek, durmak
Yüzme sporu yapmak
Bir sıvının yüzeyinde batmadan durmak
Herhangi bir durumun en aşırı derecesinde olmak
Dalgalanmak
Herhangi bir şeyle üzeri kaplanmak, bir şeye bulanmak
Derisini çıkarmak, derisini soymak
Çok para istemek
```
### Dokümantasyon / Documentation
Dokümanlar henüz hazır değil. Hazır olunca burada olacak.\
Docs are not ready yet. They will be here when they're completed.\
\
Ama kullanımla ilgili bilgi için kaynak kodlarındaki yorum satırlarını okuyabilirsiniz.\
But you can read the explanations in the source code.
### Katkı Yap / Contribute
Katkı yapmak için bu projeyi forklayın, geliştirin ve bir pull request ekleyin.\
To contribute this project: Fork, develop and submit a pull request.
### LICENSE
This project is distributed under MIT License.