semvec/pypi-packages huggingface dataset:
netpeakPsel 0.1.5
A tool for parsing external links from specific sections of a website (header, footer, nav, aside).
License: MIT
Requires Python: >=3.6


# NetpeakPsel

**NetpeakPsel** is a tool for extracting external links from specific sections of web pages, such as `header`, `footer`, `nav`, and `aside`.

## Installation

You can install the package via `pip`:

```bash
pip install netpeakPsel
```

## How to Use?

### 1. Initializing Components

To start using the package, you need to initialize the main components:

```python
from netpeakPsel import *

# Initialize the request handler with a delay (default is 1 second)
request_handler = RequestHandler(delay=1)

# Initialize the cache manager with the cache file (default is 'cache.txt')
cache_manager = CacheManager(cache_file='cache.txt')

# Create the Crawler instance with the request handler and cache manager
crawler = Crawler(request_handler, cache_manager)

```

### 2. Parsing a Single URL

To extract external links from a single URL and save them in a CSV file:

```python
crawler.parse_url('https://example.com')
```

This will create a CSV file named `example.com_sitewide_links.csv` containing all the extracted external links.

### 3. Parsing a List of Domains from a File

To parse external links from multiple domains listed in a text file:

1. Create a file named `domains.txt` with each domain on a new line:
   ```
   example.com
   anotherdomain.com
   samplewebsite.org
   ```

2. Use the following command to parse all the domains and save the results in a single CSV file:

```python
crawler.parse_list_domain('domains.txt', 'sitewide_external_links.csv')
```

This will create a single CSV file (`sitewide_external_links.csv`) containing external links from all domains listed in `domains.txt`.

### 4. Full Website Content Parsing
To parse all content from a specific website:

```python
from netpeakPsel import ContentParser

parser = ContentParser("https://galinov.com/", "test.galinov.com", "results.csv")
parser.crawl()
```

## Features

- Extracts external links from the `header`, `footer`, `nav`, and `aside` sections of web pages.
- Caches processed URLs to avoid redundant parsing.
- Supports parsing multiple domains from a file.
- Saves results in CSV format for easy data analysis.

## Requirements

- Python 3.6 or later
- The following Python packages:
  - `requests`
  - `beautifulsoup4`
  - `lxml`
  - `tqdm`
  - `colorama`
  

These dependencies will be installed automatically when you install the package via `pip`.



## Contributing

If you'd like to contribute, feel free to fork the repository and submit a pull request. Please make sure to update tests as appropriate. [GitHub Repo](https://github.com/VsevolodKrasovskyi/netpeakPsel/)
kmviz 0.8.0
A web interface for querying biological sequence indexes.
License: MIT
Requires Python: <4.0,>=3.9

# kmviz

![GitHub Release](https://img.shields.io/github/v/release/tlemane/kmviz?style=for-the-badge&logo=github)
![PyPI - Version](https://img.shields.io/pypi/v/kmviz?style=for-the-badge&color=blue&logo=pypi)
![Docker Image Version](https://img.shields.io/docker/v/tlemane/kmviz?style=for-the-badge&logo=docker&label=docker%20hub&color=blue)

![GitHub Actions Workflow Status](https://img.shields.io/github/actions/workflow/status/tlemane/kmviz/ci.yml?style=for-the-badge&logo=github&label=kmviz-ci)
![PyPI - Python Version](https://img.shields.io/pypi/pyversions/kmviz?style=for-the-badge&logo=python)

**kmviz** is a user-friendly web interface for interacting with biological sequence indexes. In a nutshell, it connects to multiple, local or distant, sequence indexes to performs sequence queries. Results can then be explored through *`tables`*, *`plots`*, *`sequence views`*, or even *`maps`* when metadata contains geographical information. Note that representations are fully customizable allowing to make production-grade figures.

:warning: **kmviz** is a work in progress!

See [kmviz documentation](https://tlemane.github.io/kmviz).
seleniumplusplus 0.1.6
Speeds up automation when using selenium
License: MIT
Requires Python: <4.0,>=3.10

This library provides a set of utility functions and classes to facilitate automated web interactions using Selenium WebDriver. It includes functionalities for waiting for elements, interacting with elements, and performing various actions on web elements. The library is designed to be easy to use and flexible, allowing users to quickly create automated web interactions without having to write complex code.