writinwaters
commited on
Commit
·
c957852
1
Parent(s):
e06e08c
Editorial updates (#168)
Browse files
README.md
CHANGED
|
@@ -20,16 +20,17 @@
|
|
| 20 |
<img height="21" src="https://img.shields.io/badge/License-Apache--2.0-ffffff?style=flat-square&labelColor=d4eaf7&color=7d09f1" alt="license">
|
| 21 |
</a>
|
| 22 |
</p>
|
| 23 |
-
|
| 24 |
-
|
|
|
|
| 25 |
|
| 26 |
<div align="center" style="margin-top:20px;margin-bottom:20px;">
|
| 27 |
<img src="https://github.com/infiniflow/ragflow/assets/12318111/b24a7a5f-4d1d-4a30-90b1-7b0ec558b79d" width="1000"/>
|
| 28 |
</div>
|
| 29 |
|
| 30 |
-
## 🌟Key Features
|
| 31 |
- 🍭**Custom-build document understanding engine.** Our deep learning engine is made according to the needs of analyzing and searching various type of documents in different domain.
|
| 32 |
-
- For documents from different domain for different purpose, the engine
|
| 33 |
- Easily intervene and manipulate the data proccessing procedure when things goes beyond expectation.
|
| 34 |
- Multi-media document understanding is supported using OCR and multi-modal LLM.
|
| 35 |
- 🍭**State-of-the-art table structure and layout recognition.** Precisely extract and understand the document including table content. See [README.](./deepdoc/README.md)
|
|
@@ -46,34 +47,52 @@
|
|
| 46 |
|
| 47 |
## 🤺RagFlow vs. other RAG applications
|
| 48 |
|
|
|
|
| 49 |
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
## 🎬 Get Started
|
| 52 |
|
| 53 |
-
### 📝Prerequisites
|
|
|
|
| 54 |
- CPU >= 2 cores
|
| 55 |
- RAM >= 8 GB
|
|
|
|
|
|
|
| 56 |
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
vm.max_map_count
|
| 61 |
-
```
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
```
|
| 66 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 67 |
|
| 68 |
-
```bash
|
| 69 |
-
vm.max_map_count=262144
|
| 70 |
-
```
|
| 71 |
|
| 72 |
-
### Install docker
|
| 73 |
|
| 74 |
-
|
| 75 |
|
| 76 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 77 |
|
| 78 |
> - In [service_conf.yaml](./docker/service_conf.yaml), configuration of *LLM* in **user_default_llm** is strongly recommended.
|
| 79 |
> In **user_default_llm** of [service_conf.yaml](./docker/service_conf.yaml), you need to specify LLM factory and your own _API_KEY_.
|
|
@@ -83,7 +102,7 @@ Settings the next time you log in to the system.
|
|
| 83 |
> [OpenAI](https://platform.openai.com/login?launch), [Tongyi-Qianwen](https://dashscope.console.aliyun.com/model),
|
| 84 |
> [ZHIPU-AI](https://open.bigmodel.cn/), [Moonshot](https://platform.moonshot.cn/docs/docs)
|
| 85 |
```bash
|
| 86 |
-
|
| 87 |
$ cd ragflow/docker
|
| 88 |
$ docker compose up -d
|
| 89 |
```
|
|
@@ -98,11 +117,11 @@ $ docker compose up -d
|
|
| 98 |
```
|
| 99 |
> The core image is about 15 GB in size and may take a while to load.
|
| 100 |
|
| 101 |
-
Check the server status after pulling all images and
|
| 102 |
```bash
|
| 103 |
$ docker logs -f ragflow-server
|
| 104 |
```
|
| 105 |
-
*
|
| 106 |
|
| 107 |
```bash
|
| 108 |
____ ______ __
|
|
@@ -118,20 +137,17 @@ $ docker logs -f ragflow-server
|
|
| 118 |
INFO:werkzeug:Press CTRL+C to quit
|
| 119 |
|
| 120 |
```
|
| 121 |
-
|
| 122 |
-
> The default serving port is 80, if you want to change that, refer to the [docker-compose.yml](./docker-compose.yaml) and change the left part of *'80:80'*'.
|
| 123 |
|
| 124 |
-
## 🔎System Architecture
|
| 125 |
|
| 126 |
-
<div align="center" style="margin-top:20px;margin-bottom:20px;">
|
| 127 |
-
<img src="https://github.com/infiniflow/ragflow/assets/12318111/d6ac5664-c237-4200-a7c2-a4a00691b485" width="1000"/>
|
| 128 |
-
</div>
|
| 129 |
|
| 130 |
## 🔧 Configurations
|
| 131 |
|
|
|
|
|
|
|
| 132 |
If you need to change the default setting of the system when you deploy it. There several ways to configure it.
|
| 133 |
Please refer to this [README](./docker/README.md) to manually update the configuration.
|
| 134 |
-
|
| 135 |
|
| 136 |
> If you want to change the basic setups, like port, password .etc., please refer to [.env](./docker/.env) before starting up the system.
|
| 137 |
|
|
@@ -141,15 +157,12 @@ After changing something, please run *docker-compose up -d* again.
|
|
| 141 |
|
| 142 |
See the [RagFlow Roadmap 2024](https://github.com/infiniflow/ragflow/issues/162)
|
| 143 |
|
| 144 |
-
## 🏄Community
|
| 145 |
|
| 146 |
- [Discord](https://discord.gg/uqQ4YMDf)
|
| 147 |
-
-
|
| 148 |
-
-
|
| 149 |
-
- YouTube
|
| 150 |
-
- WeChat
|
| 151 |
-
|
| 152 |
|
| 153 |
## 🙌 Contributing
|
| 154 |
|
| 155 |
-
|
|
|
|
| 20 |
<img height="21" src="https://img.shields.io/badge/License-Apache--2.0-ffffff?style=flat-square&labelColor=d4eaf7&color=7d09f1" alt="license">
|
| 21 |
</a>
|
| 22 |
</p>
|
| 23 |
+
## 💡 What is RagFlow?
|
| 24 |
+
|
| 25 |
+
[RagFlow](http://demo.ragflow.io) is a knowledge management platform built on custom-build document understanding engine and LLM, with reasoned and well-founded answers to your question. Clone this repository, you can deploy your own knowledge management platform to empower your business with AI.
|
| 26 |
|
| 27 |
<div align="center" style="margin-top:20px;margin-bottom:20px;">
|
| 28 |
<img src="https://github.com/infiniflow/ragflow/assets/12318111/b24a7a5f-4d1d-4a30-90b1-7b0ec558b79d" width="1000"/>
|
| 29 |
</div>
|
| 30 |
|
| 31 |
+
## 🌟 Key Features
|
| 32 |
- 🍭**Custom-build document understanding engine.** Our deep learning engine is made according to the needs of analyzing and searching various type of documents in different domain.
|
| 33 |
+
- For documents from different domain for different purpose, the engine applies different analyzing and search strategy.
|
| 34 |
- Easily intervene and manipulate the data proccessing procedure when things goes beyond expectation.
|
| 35 |
- Multi-media document understanding is supported using OCR and multi-modal LLM.
|
| 36 |
- 🍭**State-of-the-art table structure and layout recognition.** Precisely extract and understand the document including table content. See [README.](./deepdoc/README.md)
|
|
|
|
| 47 |
|
| 48 |
## 🤺RagFlow vs. other RAG applications
|
| 49 |
|
| 50 |
+
## 🔎 System Architecture
|
| 51 |
|
| 52 |
+
<div align="center" style="margin-top:20px;margin-bottom:20px;">
|
| 53 |
+
<img src="https://github.com/infiniflow/ragflow/assets/12318111/d6ac5664-c237-4200-a7c2-a4a00691b485" width="1000"/>
|
| 54 |
+
</div>
|
| 55 |
|
| 56 |
## 🎬 Get Started
|
| 57 |
|
| 58 |
+
### 📝 Prerequisites
|
| 59 |
+
|
| 60 |
- CPU >= 2 cores
|
| 61 |
- RAM >= 8 GB
|
| 62 |
+
- Docker
|
| 63 |
+
- `vm.max_map_count` > 65535
|
| 64 |
|
| 65 |
+
> To check the value of `vm.max_map_count`:
|
| 66 |
+
>
|
| 67 |
+
> ```bash
|
| 68 |
+
> $ sysctl vm.max_map_count
|
| 69 |
+
> ```
|
| 70 |
+
>
|
| 71 |
+
> Reset `vm.max_map_count` to a value greater than 65535 if it is not. In this case, we set it to 262144:
|
| 72 |
+
>
|
| 73 |
+
> ```bash
|
| 74 |
+
> $ sudo sysctl -w vm.max_map_count=262144
|
| 75 |
+
> ```
|
| 76 |
+
>
|
| 77 |
+
> This change will be reset after a system reboot. To ensure your change remains permanent, add or update the following line in **/etc/sysctl.conf** accordingly:
|
| 78 |
+
>
|
| 79 |
+
> ```bash
|
| 80 |
+
> vm.max_map_count=262144
|
| 81 |
+
> ```
|
| 82 |
|
|
|
|
|
|
|
|
|
|
| 83 |
|
|
|
|
| 84 |
|
| 85 |
+
### Start up the RagFlow server
|
| 86 |
|
| 87 |
+
1. Clone the repo
|
| 88 |
+
|
| 89 |
+
```bash
|
| 90 |
+
$ git clone https://github.com/infiniflow/ragflow.git
|
| 91 |
+
```
|
| 92 |
+
|
| 93 |
+
|
| 94 |
+
|
| 95 |
+
2.
|
| 96 |
|
| 97 |
> - In [service_conf.yaml](./docker/service_conf.yaml), configuration of *LLM* in **user_default_llm** is strongly recommended.
|
| 98 |
> In **user_default_llm** of [service_conf.yaml](./docker/service_conf.yaml), you need to specify LLM factory and your own _API_KEY_.
|
|
|
|
| 102 |
> [OpenAI](https://platform.openai.com/login?launch), [Tongyi-Qianwen](https://dashscope.console.aliyun.com/model),
|
| 103 |
> [ZHIPU-AI](https://open.bigmodel.cn/), [Moonshot](https://platform.moonshot.cn/docs/docs)
|
| 104 |
```bash
|
| 105 |
+
|
| 106 |
$ cd ragflow/docker
|
| 107 |
$ docker compose up -d
|
| 108 |
```
|
|
|
|
| 117 |
```
|
| 118 |
> The core image is about 15 GB in size and may take a while to load.
|
| 119 |
|
| 120 |
+
Check the server status after pulling all images and having Docker up and running:
|
| 121 |
```bash
|
| 122 |
$ docker logs -f ragflow-server
|
| 123 |
```
|
| 124 |
+
*The following output confirms the successful launch of the system:*
|
| 125 |
|
| 126 |
```bash
|
| 127 |
____ ______ __
|
|
|
|
| 137 |
INFO:werkzeug:Press CTRL+C to quit
|
| 138 |
|
| 139 |
```
|
| 140 |
+
In your browser, enter the IP address of your server.
|
|
|
|
| 141 |
|
|
|
|
| 142 |
|
|
|
|
|
|
|
|
|
|
| 143 |
|
| 144 |
## 🔧 Configurations
|
| 145 |
|
| 146 |
+
> The default serving port is 80, if you want to change that, refer to the [docker-compose.yml](./docker-compose.yaml) and change the left part of `80:80`, say `66:80`.
|
| 147 |
+
|
| 148 |
If you need to change the default setting of the system when you deploy it. There several ways to configure it.
|
| 149 |
Please refer to this [README](./docker/README.md) to manually update the configuration.
|
| 150 |
+
Updates to system configurations require a system reboot to take effect *docker-compose up -d* again.
|
| 151 |
|
| 152 |
> If you want to change the basic setups, like port, password .etc., please refer to [.env](./docker/.env) before starting up the system.
|
| 153 |
|
|
|
|
| 157 |
|
| 158 |
See the [RagFlow Roadmap 2024](https://github.com/infiniflow/ragflow/issues/162)
|
| 159 |
|
| 160 |
+
## 🏄 Community
|
| 161 |
|
| 162 |
- [Discord](https://discord.gg/uqQ4YMDf)
|
| 163 |
+
- [Twitter](https://twitter.com/infiniflowai)
|
| 164 |
+
- GitHub Discussions
|
|
|
|
|
|
|
|
|
|
| 165 |
|
| 166 |
## 🙌 Contributing
|
| 167 |
|
| 168 |
+
RagFlow flourishes via open-source collaboration. In this spirit, we embrace diverse contributions from the community. If you would like to be a part, review our [Contribution Guidelines](https://github.com/infiniflow/ragflow/blob/main/CONTRIBUTING.md) first.
|