semvec/pypi-packages huggingface dataset:
rabbitmq-spider 0.0.2
rabbitmq-spider is an open-source tool that helps with web scraping by using RabbitMQ and Scrapy to distribute and scale scraping tasks across multiple instances.
Requires Python: >=3.7

# rabbitmq-spider

rabbitmq-spider is an open-source tool that helps with web scraping by using RabbitMQ and Scrapy to distribute and scale
scraping tasks across multiple instances.

Inpsired by [scrapy-redis](https://github.com/rmax/scrapy-redis).

## Features

1. It only uses RabbitMQ for message generation tasks and does not use RabbitMQ to implement Scrapy’s queue.
2. It can automatically acknowledge (ack) or negatively acknowledge (nack) messages based on the response results.

## Installation 

```shell
pip install rabbitmq_spider
```
## Usage

### 1.Add config values:

```python
RABBITMQ_HOST = 'localhost'
RABBITMQ_PORT = '5672'
RABBITMQ_USERNAME = 'guest'
RABBITMQ_PASSWORD = 'guest'
RABBITMQ_VIRTUAL_HOST = '/'

SPIDER_MIDDLEWARES = {
    'rabbitscrape.middlewares.RabbitmqSpiderMiddleware': 49,
}
```

### 2.Add RabbitMQSpider to your spider

```python
import json

from rabbitmq_spider.spiders import RabbitMQSpider
from scrapy import Request


class YourSpider(RabbitMQSpider):
    """Demo"""
    name = 'demo'
    routing_key = 'demo.queue'

    def make_request_from_data(self, data):
        msg_dict = json.loads(data)
        url = msg_dict['url']

        return Request(url)

    def parse(self, response, **kwargs):
        self.logger.debug(response.status)
```

## License

This project is licensed under the MIT License - see the LICENSE file for details.
climpie 0.1.0
Tools for calculating entities' emissions budgets and associated emissions pathways.
Requires Python: >=3.9,<4.0

# Climpie

<!---
Can use start-after and end-before directives in docs, see
https://myst-parser.readthedocs.io/en/latest/syntax/organising_content.html#inserting-other-documents-directly-into-the-current-document
-->

<!--- sec-begin-description -->

Tools for calculating entities' emissions budgets and associated emissions pathways.


[#5 badges here]


<!--- sec-end-description -->

Full documentation can be found at:
[climpie.readthedocs.io](https://climpie.readthedocs.io/en/latest/).
We recommend reading the docs there because the internal documentation links
don't render correctly on GitLab's viewer.

## Installation

<!--- sec-begin-installation -->

Climpie can be installed with conda or pip:

```bash
pip install climpie
conda install -c conda-forge climpie
```

Additional dependencies can be installed using

```bash
# To add plotting dependencies
pip install climpie[plots]
# To add notebook dependencies
pip install climpie[notebooks]

# If you are installing with conda, we recommend
# installing the extras by hand because there is no stable
# solution yet (issue here: https://github.com/conda/conda/issues/7502)
```

<!--- sec-end-installation -->

### For developers

<!--- sec-begin-installation-dev -->

For development, we rely on [poetry](https://python-poetry.org) for all our
dependency management. To get started, you will need to make sure that poetry
is installed
([instructions here](https://python-poetry.org/docs/#installing-with-the-official-installer),
we found that pipx and pip worked better to install on a Mac).

For all of work, we use our `Makefile`.
You can read the instructions out and run the commands by hand if you wish,
but we generally discourage this because it can be error prone.
In order to create your environment, run `make virtual-environment`.

If there are any issues, the messages from the `Makefile` should guide you
through. If not, please raise an issue in the [issue tracker][issue_tracker].

For the rest of our developer docs, please see [](development-reference).

[issue_tracker]: https://gitlab.com/climate-resource/climpie/issues

<!--- sec-end-installation-dev -->
lamineml 0.0.73
use this library in kivy android
Requires Python: >=3.8


# Make sure you have upgraded version of pip
Windows
```
py -m pip install --upgrade pip
```

Linux/MAC OS
```
python3 -m pip install --upgrade pip
```

## Create a project with the following structure
```
packaging_tutorial/
├── LICENSE
├── pyproject.toml
├── README.md
├── setup.cfg
├── src/
│   └── example_package/
│       ├── __init__.py
│       └── example.py
└── tests/
touch LICENSE
touch pyproject.toml
touch setup.cfg
mkdir src/mypackage
touch src/mypackage/__init__.py
touch src/mypackage/main.py
mkdir tests
```

## pyproject.toml 

This file tells tools like pip and build how to create your project

```
[build-system]
requires = [
    "setuptools>=42",
    "wheel"
]
build-backend = "setuptools.build_meta"
```
build-system.requires gives a list of packages that are needed to build your package. Listing something here will only make it available during the build, not after it is installed.

build-system.build-backend is the name of Python object that will be used to perform the build. If you were to use a different build system, such as flit or poetry, those would go here, and the configuration details would be completely different than the setuptools configuration described below.


# Setup.cfg setup
Using setup.cfg is a best practice, but you could have a dynamic setup file using setup.py

```
[metadata]
name = example-pkg-YOUR-USERNAME-HERE
version = 0.0.1
author = Example Author
author_email = author@example.com
description = A small example package
long_description = file: README.md
long_description_content_type = text/markdown
url = https://github.com/pypa/sampleproject
project_urls =
    Bug Tracker = https://github.com/pypa/sampleproject/issues
classifiers =
    Programming Language :: Python :: 3
    License :: OSI Approved :: MIT License
    Operating System :: OS Independent

[options]
package_dir =
    = src
packages = find:
python_requires = >=3.6

[options.packages.find]
where = src

```
# Running the build
### Make sure your build tool is up to date
Windows
```
py -m pip install --upgrade build
```
Linux/MAC OS
```
python3 -m pip install --upgrade build
```


### Create the build
```
py -m build
```













### References
https://packaging.python.org/tutorials/packaging-projects/
RabbitScrape 0.0.1
RabbitScrape is an open-source tool that helps with web scraping by using RabbitMQ and Scrapy to distribute and scale scraping tasks across multiple instances.
Requires Python: >=3.7

# RabbitScrape

RabbitScrape is an open-source tool that helps with web scraping by using RabbitMQ and Scrapy to distribute and scale
scraping tasks across multiple instances.

Inpsired by [scrapy-redis](https://github.com/rmax/scrapy-redis).

## Features

1. It only uses RabbitMQ for message generation tasks and does not use RabbitMQ to implement Scrapy’s queue.
2. It can automatically acknowledge (ack) or negatively acknowledge (nack) messages based on the response results.

## Installation 

```shell
pip install RabbitScrape
```
## Usage

### 1.Add config values:

```python
RABBITMQ_HOST = 'localhost'
RABBITMQ_PORT = '5672'
RABBITMQ_USERNAME = 'guest'
RABBITMQ_PASSWORD = 'guest'
RABBITMQ_VIRTUAL_HOST = '/'

SPIDER_MIDDLEWARES = {
    'rabbitscrape.middlewares.RabbitmqSpiderMiddleware': 49,
}
```

### 2.Add RabbitMQSpider to your spider

```python
from rabbit_scrape import RabbitMQSpider
import json
from scrapy import Request

class YourSpider(RabbitMQSpider):
    """Demo"""
    name = 'demo'
    api = 'demo.queue'
    
    def make_request_from_data(self, data):
        msg_dict = json.loads(data)
        url = msg_dict['url']
    
        return Request(url)
    
    def parse(self, response, **kwargs):
        self.logger.debug(response.status)
```

## License

This project is licensed under the MIT License - see the LICENSE file for details.