semvec/pypi-packages huggingface dataset:
scrapy-custom-delay 0.0.2
This package provides a way to let you set different delay for different website, using the Scrapy framework.
Requires Python: >=3.7

# Scrapy-Custom-Delay

[![PyPI](https://img.shields.io/pypi/v/scrapy-custom-delay)](https://pypi.org/project/scrapy-custom-delay/)
[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/scrapy-custom-delay)](https://pypi.org/project/scrapy-custom-delay/)

`Scrapy-Custom-Delay` is a package that lets you set different delay for different website, using the [Scrapy](https://github.com/scrapy/scrapy) framework.

## Install
```
$ pip install scrapy-custom-delay
```

## Usage

### Step 1: Use the following config values in your scrapy settings:

1. Enable the AutoThrottle extension.

	```python
	AUTOTHROTTLE_ENABLED = True
	```

2. Enable the Custom Delay Throttle by adding it to `EXTENSIONS`.

	```python
	EXTENSIONS = {
	    'scrapy.extensions.throttle.AutoThrottle': None,
	    'scrapy_domain_delay.extensions.CustomDelayThrottle': 300,
	}
	```

3. Add `{'regex': 'download delay (in seconds)'}` to the `DOMAIN_DELAYS`.

	something like:

	```python
	# set up custom delays per domain
    # if two or more regexes satisfy, the first one will be used
	DOMAIN_DELAYS = {
	    r'^images.google.com*$': 1.0,
	    r'*github*': 0.5,
	}
	```
pollai 0.1.1
AI models simplified and implemented
Requires Python: >=3.7

# Documentation
Documentation for the PollAI library

# Changelogs
## 0.0.1 (First Release)
==============
- First Release
- Rule based model class and ML model class implementation
## 0.1.1
=======
- Fix pip bugs

## How to initialize the ML_Model class:
from pollai import ML_Model # Can also be * (which imports all classes and functions)

model = ML_Model(training_data) # params: self, training_data

## Training the model
from pollai import ML_Model # Can also be * (which imports all classes and functions)

model = ML_Model(training_data) # initialize the model first

model.train() # no params required. trains the model

## Running the model
from pollai import ML_Model # Can also be * (which imports all classes and functions)

model = ML_Model(training_data) # initialize the model first

model.train() # train the model first to avoid the TrainingException exception.

## Exceptions:
TrainingException:
Exception when training is incomplete or not implemented at all. The model needs to be trained to produce the expected accurate results.

# Imperfections in AI
Don't get me wrong, AI is amazing. However, it could use improvements. PollAI is imperfect too! Machine learning, Rule based, any AI model has imperfections and can be improved. For example, Machine Learning requires lots of computational resources and Rule based models are constantly inaccurate.