semvec/pypi-packages huggingface dataset:
ruia-ua 0.0.2
ruia_ua - simple user-agent middleware for Ruia.
License: MIT

## ruia-ua

simple user-agent middleware for [Ruia](https://github.com/howie6879/ruia)

### Installation

```shell
pip install -U ruia-ua
```

### Usage

`ruia-ua` will be automatically with a random `User-Agent` for your request's `headers`

```python
from ruia import AttrField, TextField, Item, Spider
from ruia_ua import middleware


class HackerNewsItem(Item):
    target_item = TextField(css_select='tr.athing')
    title = TextField(css_select='a.storylink')
    url = AttrField(css_select='a.storylink', attr='href')


class HackerNewsSpider(Spider):
    start_urls = ['https://news.ycombinator.com/news?p=1', 'https://news.ycombinator.com/news?p=2']

    async def parse(self, response):
        # Do something...
        print(response.html)


if __name__ == '__main__':
    HackerNewsSpider.start(middleware=middleware)
```

Enjoy it :)