semvec/pypi-packages huggingface dataset:
scrapy-wayback-middleware 0.3.3
Scrapy middleware for submitting URLs to the Internet Archive Wayback Machine
License: MIT
Requires Python: >=3.6.1,<4.0

# Scrapy Wayback Middleware

[![Build status](https://github.com/pjsier/scrapy-wayback-middleware/workflows/CI/badge.svg)](https://github.com/pjsier/scrapy-wayback-middleware/actions)

Middleware for submitting all scraped response URLs to the [Internet Archive Wayback Machine](https://archive.org/web/) for archival.

## Installation

```bash
pip install scrapy-wayback-middleware
```

## Setup

Add `scrapy_wayback_middleware.WaybackMiddleware` to your project's `SPIDER_MIDDLEWARES` settings. By default, the middleware will make `GET` requests to `web.archive.org/save/{URL}`, but if the `WAYBACK_MIDDLEWARE_POST` setting is `True` then it will make POST requests to [`pragma.archivelab.org`](https://archive.readme.io/docs/creating-a-snapshot) instead.

## Configuration

To configure custom behavior for certain methods, subclass `WaybackMiddleware` and override the `get_item_urls` method to pull additional links to archive from individual items or `handle_wayback` to change how responses from the Wayback Machine are handled. The `WAYBACK_MIDDLEWARE_POST` can be set to `True` to adjust request behavior.

### Duplicate Filtering

In order to avoid sending duplicate requests with `WAYBACK_MIDDLEWARE_POST` set to `False`, you'll need to either include `web.archive.org` in your spider's `allowed_domains` property (if specified) or disable `scrapy.spidermiddlewares.offsite.OffsiteMiddleware` in your settings.

### Rate Limits

While neither endpoint returns headers indicating specific rate limits, the `GET` endpoint at `web.archive.org/save` has a rate limit of 25 requests/minute, resetting each minute. The middleware is configured to wait for 60 seconds whenever it sees a 429 error code to handle this.
sentry-for-wxwork 1.1.0
A Sentry extension which send errors stats to WxWork
License: MIT
Keywords: sentry wxwork

# Sentry-for-WxWork
# 1 项目介绍
本项目是模仿[sentry-10-dingding](https://github.com/FeSeason/sentry-10-dingding.git)，专为企业微信群聊机器人写的报警消息插件。
如果你想使用钉钉的机器人作为sentry报警的工具，可以去使用[sentry-10-dingding](https://github.com/FeSeason/sentry-10-dingding.git)
# 2 使用方法
## 2.1 安装
可以修改sentry项目中requirement.txt文件，增加sentry-for-wxwork
```
# requirement.txt

sentry-for-wxwork
```
然后使用以下docker命令重新部署即可
```bazaar
# 目前，对于self-hosted版本的开源sentry来说，需要先运行
./install.sh

# 然后在运行
docker-compose up -d 
```
如果是你的sentry服务已经部署好了，依然需要重新运行上面两个命令，才能重新安装好新的插件

## 2.2 使用
### 2.2.1 先在整个sentry的Settings里面找到WxWork，如下图所示
![找到Wxwork](images/Wxwork.png)
### 2.2.2 然后在可以在你所建的项目的Settings中找到 Legacy integrations, 在里面把WxWork打开
![找到Legacy_ntegrations](images/Legacy_ntegrations.png)
### 2.2.3 然后刷新一下，可以在你所建的项目中，看到WxWork，接着配置上你的token即可，如下图所示。
注意，这里的token，即为你在配置企微群机器人得到的url中的key的值。
![找到token](images/token.png)

# 3 FAQ
如果您在使用过程中，有任何问题，可以给我提交issue