writinwaters
commited on
Commit
·
c957852
1
Parent(s):
e06e08c
Editorial updates (#168)
Browse files
README.md
CHANGED
@@ -20,16 +20,17 @@
|
|
20 |
<img height="21" src="https://img.shields.io/badge/License-Apache--2.0-ffffff?style=flat-square&labelColor=d4eaf7&color=7d09f1" alt="license">
|
21 |
</a>
|
22 |
</p>
|
23 |
-
|
24 |
-
|
|
|
25 |
|
26 |
<div align="center" style="margin-top:20px;margin-bottom:20px;">
|
27 |
<img src="https://github.com/infiniflow/ragflow/assets/12318111/b24a7a5f-4d1d-4a30-90b1-7b0ec558b79d" width="1000"/>
|
28 |
</div>
|
29 |
|
30 |
-
## 🌟Key Features
|
31 |
- 🍭**Custom-build document understanding engine.** Our deep learning engine is made according to the needs of analyzing and searching various type of documents in different domain.
|
32 |
-
- For documents from different domain for different purpose, the engine
|
33 |
- Easily intervene and manipulate the data proccessing procedure when things goes beyond expectation.
|
34 |
- Multi-media document understanding is supported using OCR and multi-modal LLM.
|
35 |
- 🍭**State-of-the-art table structure and layout recognition.** Precisely extract and understand the document including table content. See [README.](./deepdoc/README.md)
|
@@ -46,34 +47,52 @@
|
|
46 |
|
47 |
## 🤺RagFlow vs. other RAG applications
|
48 |
|
|
|
49 |
|
|
|
|
|
|
|
50 |
|
51 |
## 🎬 Get Started
|
52 |
|
53 |
-
### 📝Prerequisites
|
|
|
54 |
- CPU >= 2 cores
|
55 |
- RAM >= 8 GB
|
|
|
|
|
56 |
|
57 |
-
|
58 |
-
|
59 |
-
|
60 |
-
vm.max_map_count
|
61 |
-
```
|
62 |
-
|
63 |
-
|
64 |
-
|
65 |
-
```
|
66 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
67 |
|
68 |
-
```bash
|
69 |
-
vm.max_map_count=262144
|
70 |
-
```
|
71 |
|
72 |
-
### Install docker
|
73 |
|
74 |
-
|
75 |
|
76 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
77 |
|
78 |
> - In [service_conf.yaml](./docker/service_conf.yaml), configuration of *LLM* in **user_default_llm** is strongly recommended.
|
79 |
> In **user_default_llm** of [service_conf.yaml](./docker/service_conf.yaml), you need to specify LLM factory and your own _API_KEY_.
|
@@ -83,7 +102,7 @@ Settings the next time you log in to the system.
|
|
83 |
> [OpenAI](https://platform.openai.com/login?launch), [Tongyi-Qianwen](https://dashscope.console.aliyun.com/model),
|
84 |
> [ZHIPU-AI](https://open.bigmodel.cn/), [Moonshot](https://platform.moonshot.cn/docs/docs)
|
85 |
```bash
|
86 |
-
|
87 |
$ cd ragflow/docker
|
88 |
$ docker compose up -d
|
89 |
```
|
@@ -98,11 +117,11 @@ $ docker compose up -d
|
|
98 |
```
|
99 |
> The core image is about 15 GB in size and may take a while to load.
|
100 |
|
101 |
-
Check the server status after pulling all images and
|
102 |
```bash
|
103 |
$ docker logs -f ragflow-server
|
104 |
```
|
105 |
-
*
|
106 |
|
107 |
```bash
|
108 |
____ ______ __
|
@@ -118,20 +137,17 @@ $ docker logs -f ragflow-server
|
|
118 |
INFO:werkzeug:Press CTRL+C to quit
|
119 |
|
120 |
```
|
121 |
-
|
122 |
-
> The default serving port is 80, if you want to change that, refer to the [docker-compose.yml](./docker-compose.yaml) and change the left part of *'80:80'*'.
|
123 |
|
124 |
-
## 🔎System Architecture
|
125 |
|
126 |
-
<div align="center" style="margin-top:20px;margin-bottom:20px;">
|
127 |
-
<img src="https://github.com/infiniflow/ragflow/assets/12318111/d6ac5664-c237-4200-a7c2-a4a00691b485" width="1000"/>
|
128 |
-
</div>
|
129 |
|
130 |
## 🔧 Configurations
|
131 |
|
|
|
|
|
132 |
If you need to change the default setting of the system when you deploy it. There several ways to configure it.
|
133 |
Please refer to this [README](./docker/README.md) to manually update the configuration.
|
134 |
-
|
135 |
|
136 |
> If you want to change the basic setups, like port, password .etc., please refer to [.env](./docker/.env) before starting up the system.
|
137 |
|
@@ -141,15 +157,12 @@ After changing something, please run *docker-compose up -d* again.
|
|
141 |
|
142 |
See the [RagFlow Roadmap 2024](https://github.com/infiniflow/ragflow/issues/162)
|
143 |
|
144 |
-
## 🏄Community
|
145 |
|
146 |
- [Discord](https://discord.gg/uqQ4YMDf)
|
147 |
-
-
|
148 |
-
-
|
149 |
-
- YouTube
|
150 |
-
- WeChat
|
151 |
-
|
152 |
|
153 |
## 🙌 Contributing
|
154 |
|
155 |
-
|
|
|
20 |
<img height="21" src="https://img.shields.io/badge/License-Apache--2.0-ffffff?style=flat-square&labelColor=d4eaf7&color=7d09f1" alt="license">
|
21 |
</a>
|
22 |
</p>
|
23 |
+
## 💡 What is RagFlow?
|
24 |
+
|
25 |
+
[RagFlow](http://demo.ragflow.io) is a knowledge management platform built on custom-build document understanding engine and LLM, with reasoned and well-founded answers to your question. Clone this repository, you can deploy your own knowledge management platform to empower your business with AI.
|
26 |
|
27 |
<div align="center" style="margin-top:20px;margin-bottom:20px;">
|
28 |
<img src="https://github.com/infiniflow/ragflow/assets/12318111/b24a7a5f-4d1d-4a30-90b1-7b0ec558b79d" width="1000"/>
|
29 |
</div>
|
30 |
|
31 |
+
## 🌟 Key Features
|
32 |
- 🍭**Custom-build document understanding engine.** Our deep learning engine is made according to the needs of analyzing and searching various type of documents in different domain.
|
33 |
+
- For documents from different domain for different purpose, the engine applies different analyzing and search strategy.
|
34 |
- Easily intervene and manipulate the data proccessing procedure when things goes beyond expectation.
|
35 |
- Multi-media document understanding is supported using OCR and multi-modal LLM.
|
36 |
- 🍭**State-of-the-art table structure and layout recognition.** Precisely extract and understand the document including table content. See [README.](./deepdoc/README.md)
|
|
|
47 |
|
48 |
## 🤺RagFlow vs. other RAG applications
|
49 |
|
50 |
+
## 🔎 System Architecture
|
51 |
|
52 |
+
<div align="center" style="margin-top:20px;margin-bottom:20px;">
|
53 |
+
<img src="https://github.com/infiniflow/ragflow/assets/12318111/d6ac5664-c237-4200-a7c2-a4a00691b485" width="1000"/>
|
54 |
+
</div>
|
55 |
|
56 |
## 🎬 Get Started
|
57 |
|
58 |
+
### 📝 Prerequisites
|
59 |
+
|
60 |
- CPU >= 2 cores
|
61 |
- RAM >= 8 GB
|
62 |
+
- Docker
|
63 |
+
- `vm.max_map_count` > 65535
|
64 |
|
65 |
+
> To check the value of `vm.max_map_count`:
|
66 |
+
>
|
67 |
+
> ```bash
|
68 |
+
> $ sysctl vm.max_map_count
|
69 |
+
> ```
|
70 |
+
>
|
71 |
+
> Reset `vm.max_map_count` to a value greater than 65535 if it is not. In this case, we set it to 262144:
|
72 |
+
>
|
73 |
+
> ```bash
|
74 |
+
> $ sudo sysctl -w vm.max_map_count=262144
|
75 |
+
> ```
|
76 |
+
>
|
77 |
+
> This change will be reset after a system reboot. To ensure your change remains permanent, add or update the following line in **/etc/sysctl.conf** accordingly:
|
78 |
+
>
|
79 |
+
> ```bash
|
80 |
+
> vm.max_map_count=262144
|
81 |
+
> ```
|
82 |
|
|
|
|
|
|
|
83 |
|
|
|
84 |
|
85 |
+
### Start up the RagFlow server
|
86 |
|
87 |
+
1. Clone the repo
|
88 |
+
|
89 |
+
```bash
|
90 |
+
$ git clone https://github.com/infiniflow/ragflow.git
|
91 |
+
```
|
92 |
+
|
93 |
+
|
94 |
+
|
95 |
+
2.
|
96 |
|
97 |
> - In [service_conf.yaml](./docker/service_conf.yaml), configuration of *LLM* in **user_default_llm** is strongly recommended.
|
98 |
> In **user_default_llm** of [service_conf.yaml](./docker/service_conf.yaml), you need to specify LLM factory and your own _API_KEY_.
|
|
|
102 |
> [OpenAI](https://platform.openai.com/login?launch), [Tongyi-Qianwen](https://dashscope.console.aliyun.com/model),
|
103 |
> [ZHIPU-AI](https://open.bigmodel.cn/), [Moonshot](https://platform.moonshot.cn/docs/docs)
|
104 |
```bash
|
105 |
+
|
106 |
$ cd ragflow/docker
|
107 |
$ docker compose up -d
|
108 |
```
|
|
|
117 |
```
|
118 |
> The core image is about 15 GB in size and may take a while to load.
|
119 |
|
120 |
+
Check the server status after pulling all images and having Docker up and running:
|
121 |
```bash
|
122 |
$ docker logs -f ragflow-server
|
123 |
```
|
124 |
+
*The following output confirms the successful launch of the system:*
|
125 |
|
126 |
```bash
|
127 |
____ ______ __
|
|
|
137 |
INFO:werkzeug:Press CTRL+C to quit
|
138 |
|
139 |
```
|
140 |
+
In your browser, enter the IP address of your server.
|
|
|
141 |
|
|
|
142 |
|
|
|
|
|
|
|
143 |
|
144 |
## 🔧 Configurations
|
145 |
|
146 |
+
> The default serving port is 80, if you want to change that, refer to the [docker-compose.yml](./docker-compose.yaml) and change the left part of `80:80`, say `66:80`.
|
147 |
+
|
148 |
If you need to change the default setting of the system when you deploy it. There several ways to configure it.
|
149 |
Please refer to this [README](./docker/README.md) to manually update the configuration.
|
150 |
+
Updates to system configurations require a system reboot to take effect *docker-compose up -d* again.
|
151 |
|
152 |
> If you want to change the basic setups, like port, password .etc., please refer to [.env](./docker/.env) before starting up the system.
|
153 |
|
|
|
157 |
|
158 |
See the [RagFlow Roadmap 2024](https://github.com/infiniflow/ragflow/issues/162)
|
159 |
|
160 |
+
## 🏄 Community
|
161 |
|
162 |
- [Discord](https://discord.gg/uqQ4YMDf)
|
163 |
+
- [Twitter](https://twitter.com/infiniflowai)
|
164 |
+
- GitHub Discussions
|
|
|
|
|
|
|
165 |
|
166 |
## 🙌 Contributing
|
167 |
|
168 |
+
RagFlow flourishes via open-source collaboration. In this spirit, we embrace diverse contributions from the community. If you would like to be a part, review our [Contribution Guidelines](https://github.com/infiniflow/ragflow/blob/main/CONTRIBUTING.md) first.
|