semvec/pypi-packages huggingface dataset:
tools-sushi 0.0.28a0
create applications faster than ever

<p align="center">
    <img src="img/readme.png" alt="sushi">
</p>

---

## sushi is a set of libraries to help develop applications faster

Sushi aims to make the process of creating applications faster by providing collection of libraries in python. These libraries can be used by developers to make and grow applications faster than ever.

With sushi, developers can focus on the core functionality of thier applications, rather than writing multiple functions to create a simple app.

## examples

<details>    
    <summary> http server </summary>
    <br/>

```py
from sushi.api.network.http_server import http_server
http_server(handler, ip, port, ready) # create a simple get server
```

</details>

<details>
    <summary> terminal input </summary>
    <br/>
    
    
```py
from sushi.api.terminal.input import list
list(["data1", "data2"], True) # ask user to select item(s) from list
```
</details>

<details>
    <summary> color print </summary>
    <br/>
    
    
```py
from sushi.api.terminal.colors import print_colors, colors
print_colors("hello, world", colors.orange) # prints orange 'hello, world'
```

</details>

## wiki

sushi wiki is currently hosted on [github wiki](https://github.com/sushi-tools/sushi/wiki)
reddit-multimodal 1.3.0
A scraper which will scrape out multimedia data from reddit.
Keywords: web-scraping,webscraper,reddit,multimodal,datascience

# Reddit Crawler

This is a wrapper to the `PRAW` package to scrape content from image in the form of `csv`, `json`, `tsv`, `sql` files.

This repository will help you scrape various subreddits, and will return to you multi-media attributes.

You can pip install this to integrate with some other application, or use it as an commandline application.

```commandLine
pip install reddit-multimodal
```

## How to use the repository?

Before running the code, you should have registered with the Reddit API and create a sample project to run the code and obtain the `client_id`, `client_secret` and make a `user_agent`. Then pass them in the arguements.

Although, the easier way is to use the `pip install reddit-multimodal`.

## Functionalities

This will help you scrape multiple subreddits just like `PRAW` but, will also return and save datasets for the same. Will scrape the posts and the comments as well.

### Sample Code

```python
import nltk
from reddit_multimodal.crawler import Crawler
import argparse

nltk.download("vader_lexicon")

if __name__ == "__main__":

    parser = argparse.ArgumentParser()
    parser.add_argument(
        "--subreddit_file_path",
        "A path to the file which contains the subreddits to scrape from.",
        type=str,
    )
    parser.add_argument(
        "--limit", "The limit to number of articles to scrape.", type=int
    )
    parser.add_argument("--client_id", "The Client ID provided by Reddit.", type=str)
    parser.add_argument(
        "--client_secret", "The Secret ID provided by the Reddit.", type=str
    )
    parser.add_argument(
        "--user_agent",
        "The User Agent in the form of <APP_NAME> <VERSION> by /u/<REDDIT_USERNAME>",
        type=str,
    )
    parser.add_argument(
        "--posts", "A boolean variable to parse through the posts or not.", type=bool
    )
    parser.add_argument(
        "--comments",
        "A boolean variable to parse through the comments of the top posts of subreddit",
        type=bool,
    )

    args = parser.parse_args()

    client_id = args["client_id"]
    client_secret = args["client_secret"]
    user_agent = args["user_agent"]
    file_path = args["subreddit_file_path"]
    limit = args["limit"]

    r = Crawler(client_id=client_id, client_secret=client_secret, user_agent=user_agent)

    subreddit_list = open(file_path, "r").readlines().split()

    print(subreddit_list)

    if args["posts"]:
        r.get_posts(subreddit_names=subreddit_list, sort_by="top", limit=limit)

    if args["comments"]:
        r.get_comments(subreddit_names=subreddit_list, sort_by="top", limit=limit)

```