semvec/pypi-packages huggingface dataset:
llama-index-readers-clickhouse 0.3.0
llama-index readers clickhouse integration
License: MIT
Requires Python: <4.0,>=3.9

# LlamaIndex Readers Integration: ClickHouse

## Overview

ClickHouse Reader is a tool designed to retrieve documents from ClickHouse databases efficiently.

## Installation

You can install ClickHouse Reader via pip:

```bash
pip install llama-index-readers-clickhouse
```

## Usage

```python
from llama_index.core.schema import Document
from llama_index.readers.clickhouse import ClickHouseReader

# Initialize ClickHouseReader with the connection details and configuration
reader = ClickHouseReader(
    clickhouse_host="<ClickHouse Host>",
    username="<Username>",
    password="<Password>",
    clickhouse_port=8123,  # Optional: Default port is 8123
    database="<Database Name>",
    engine="MergeTree",  # Optional: Default engine is "MergeTree"
    table="<Table Name>",
    index_type="NONE",  # Optional: Default index type is "NONE"
    metric="cosine",  # Optional: Default metric is "cosine"
    batch_size=1000,  # Optional: Default batch size is 1000
    index_params=None,  # Optional: Index parameters
    search_params=None,  # Optional: Search parameters
)

# Load data from ClickHouse
documents = reader.load_data(
    query_vector=[0.1, 0.2, 0.3],  # Query vector
    where_str=None,  # Optional: Where condition string
    limit=10,  # Optional: Number of results to return
)
```

This loader is designed to be used as a way to load data into
[LlamaIndex](https://github.com/run-llama/llama_index/tree/main/llama_index) and/or subsequently
used as a Tool in a [LangChain](https://github.com/hwchase17/langchain) Agent.
llama-index-readers-youtube-metadata 0.3.0
llama-index readers youtube-metadata integration
License: MIT
Requires Python: <4.0,>=3.9

# LlamaIndex Readers Integration: Youtube-Metadata

```bash
pip install llama_index.readers.youtube_metadata
```

This loader fetches the metadata of Youtube videos using the Google APIs. (https://www.googleapis.com/youtube/v3/videos?part=snippet,statistics&id={videos_string}&key={api_key}). You must have a Google API key to use.

Transcripts of the text transcript of Youtube videos is fetched using the `youtube_transcript_api` Python package.

## Usage

Simply pass an array of YouTube Video_ID into `load_data`.

```python
from llama_index.readers.youtube_metadata import YoutubeMetaData

api_key = "Axxxxx"  # youtube API Key

video_ids = ["S_0hBL4ILAg", "a2skIq6hFiY"]

youtube_meta = YoutubeMetaData(api_key)
details = youtube_meta.load_data(video_ids)
```

This can be combined with the YoutubeTranscriptReader to provide more information for RAG AI inquiries.

```python
from llama_index.readers.youtube_transcript import YoutubeTranscriptReader
from llama_index.readers.youtube_metadata import YoutubeMetaData

video_ids = ["S_0hBL4ILAg", "a2skIq6hFiY"]  # Example video IDs
yt_metadata = YouTubeMetaData(api_key=api_key)
print("Testing YouTubeMetaData...")
print(yt_metadata.load_data(video_ids))

yt_meta_transcript = YouTubeMetaDataAndTranscript(api_key=api_key)
print("Testing YouTubeMetaDataAndTranscript...")
print(yt_meta_transcript.load_data(video_ids))
```

The Video_id for youtube videos is right in the URL. In this URL: https://www.youtube.com/watch?v=a2skIq6hFiY&t=60s

The video_Id is 'a2skIq6hFiY&t'.
llama-index-readers-readme 0.3.0
llama-index readers readme.com integration
License: MIT
Requires Python: <4.0,>=3.9

# Readme.com Loader

```bash
pip install llama-index-readers-readme
```

This loader fetches the text from [Readme](https://readme.com/) docs guides using the Readme API. It also uses the BeautifulSoup library to parse the HTML and extract the text from the docs.

## Usage

To use this loader, you need to pass in the API Key of a Readme account.

```python
from llama_index.readers.readme import ReadmeReader

loader = ReadmeReader(api_key="YOUR_API_KEY")
documents = loader.load_data()
```

This loader is designed to be used as a way to load data into [LlamaIndex](https://github.com/run-llama/llama_index/).
llama-index-readers-feishu-wiki 0.3.0
llama-index readers feishu_wiki integration
License: MIT
Requires Python: <4.0,>=3.9

# Feishu Wiki Loader

This loader can traverse all feishu documents under the feishi space.

## Usage

To use this loader, you need to:

1. apply the permission(`wiki:wiki:readonly`) of the feishu app
2. add the feishu app as the admin of your feishu space, see [here](https://open.feishu.cn/document/server-docs/docs/wiki-v2/wiki-qa#b5da330b) for more help
3. finally, pass your feishu space id to this loader

```python
app_id = "xxx"
app_secret = "xxx"
space_id = "xxx"
FeishuWikiReader = download_loader("FeishuWikiReader")
loader = FeishuWikiReader(app_id, app_secret)
documents = loader.load_data(space_id=space_id)
```

This loader is designed to be used as a way to load data into [LlamaIndex](https://github.com/run-llama/llama_index/).
llama-index-readers-azure-devops 0.3.0
llama-index readers azure devops integration
License: MIT
Requires Python: <4.0,>=3.9

# LlamaIndex Readers Integration: Azure Devops

`pip install llama-index-readers-azure-devops`

The Azure Devops readers package enables you to read files from your azure devops repositories

The reader will require a personal access token (which you can generate under your account settings).

## Usage

This reader will read through a repo, with options to specifically filter directories and file extensions.

Here is an example of how to use it

```python
from llama_index.readers.azure_devops import AzureDevopsReader

az_devops_loader = AzureDevopsLoader(
    access_token="<your-access-token>",
    organization_name="<organization-name>",
    project_name="<project-name>",
    repo="<repository-name>",
    file_filter=lambda file_path: file_path.endswith(".py"),
)  # Optional: you can provide any callable that returns a boolean to filter files of your choice

documents = az_devops_loader.load_data(
    folder="<folder-path>",  # The folder to load documents from, defaults to root.
    branch="<branch-name>",
)  # The branch to load documents from, defaults to head of the repo
```
llama-index-readers-openapi 0.3.0
llama-index readers openapi integration
License: MIT
Requires Python: <4.0,>=3.9

# LlamaIndex Readers Integration: Open API Specification

This module provides a reader for Open API Specification (OAS) JSON files. The reader is able to parse OAS files and split them at into atomic elements, such as paths, operations, parameters, etc.

It also provides some basic customizations to the reader such as changing the depth of the split, and the ability to exclude certain elements.

## Usage

```python
from llama_index.readers.openapi import OpenAPIReader

openapi_reader = OpenAPIReader(discard=["info", "servers"])
openapi_reader.load_data("path/to/openapi.json")
```