semvec/pypi-packages huggingface dataset:
snnw 0.2.8
My custom neural net architecture written in Python to practice my ML skills.
License: MIT
Requires Python: >=3.6.0


# Slowest-Neural-Net-in-the-West
My custom neural net architecture written in Python to 
practice my ML skills.


## Install
Make a new Python virtual environment (version >= 3.6).
Install this project with pip. In terminal, run

`pip3 install snnw`

## Download MNIST dataset
Open a new Python shell or Jupyter Notebook and run

`import snnw`

Set `raw_dir = ` the directory where you want to
save the MNIST raw data files. Run

`snnw.dataset.mnist.download.raw(raw_dir)`

Set `png_dir = ` the directory where you want to
save the MNIST .png images and path text files. Run

`snnw.dataset.mnist.convert.raw_to_png(raw_dir, png_dir)`

Set `npy_dir = ` the directory where you want to
save the MNIST .npy image and label numpy arrays. Run

`snnw.dataset.mnist.convert.png_to_npy(png_dir, npy_dir)`

## Get model config
Set `config_path = ` the path to where you want to save
the training/testing model's config file. Run

`snnw.nn.config.get(config_path, 1)`
or
`snnw.nn.config.get(config_path, 2)`

to write sample config file 1 or 2 to `config_path`,
or write your own config file and place it where
`config_path` points to.

If you write a custom config file, make sure that it
follows the given format to prevent parsing errors!


## Train model
Set `model_dir = ` the directory where the trained model's
weights and biases will be stored.

Set `train_image_path = ` the path to where the .npy file for
the training image arrays are located.
This file should be located inside the `npy_dir`
you specified earlier. 

Set `train_label_path = ` the path to where the .npy file for
the training label arrays are located.
This file should be located inside the `npy_dir`
you specified earlier.

Set `steps = ` the number of training steps you would
like to train for. The default is `60,000`.

Set `learning_rate = ` the learning rate you would like to 
train with. The default is `5e-4`.

Run `snnw.run.train(model_dir, config_path, train_image_path,
train_label_path, steps, learning_rate)`.

*Note:* if you get a NaN error or "not a probability array"
error, then you probably have a vanishing or exploding
gradient problem. To fix this, try adjusting the learning rate.
The default learning rate and number of steps included
have been tested to work with both included models.

## Test model

Set `test_image_path = ` the path to where the .npy file for
the training image arrays are located.
This file should be located inside the `npy_dir`
you specified earlier. 

Set `test_label_path = ` the path to where the .npy file for
the training label arrays are located.
This file should be located inside the `npy_dir`
you specified earlier.

Run `snnw.run.evaluate(model_dir, config_path, test_image_path,
test_label_path)`.
spider911 1.0.3
spider for 91tv and test
License: MIT
Requires Python: >=3.6.0

# 爬取91tv的video
### 包括其目前为止的11w多部电影，以及每部电影的详细信息。

#### 可爬取的信息包括但不限于：
* 浏览量 <br>
* 收藏量<br>
* 演员<br>
* 分类(细分300余类)<br>
* 宣传图<br>
* 视频截图集锦<br>
* 中文标题<br>
* 中文内容描述<br>
* 上架时间<br>

----

#### 支持多进程批量下载video
注：下载原理为获取m3u8资源再通过ffmpeg转换为mp4 <br>
使用下载功能必须在电脑上安装ffmpeg并添加环境变量 <br>