quincyqiang commited on
Commit
4d7c081
1 Parent(s): a363e08

增加知识库选择

Browse files
Files changed (2) hide show
  1. README.md +4 -3
  2. requirements.txt +153 -9
README.md CHANGED
@@ -7,9 +7,10 @@
7
  ![](https://github.com/yanqiangmiffy/Chinese-LangChain/blob/master/images/web_demo.png)
8
 
9
  ## 🚀 特性
10
-
11
- - 2023/04/17 支持多种文档上传与内容解析:pdf、docx,ppt等
12
- - 2023/04/17 支持知识增量更新
 
13
 
14
  [//]: # (- 支持检索结果与LLM生成结果对比)
15
 
 
7
  ![](https://github.com/yanqiangmiffy/Chinese-LangChain/blob/master/images/web_demo.png)
8
 
9
  ## 🚀 特性
10
+ - 🚀 2023/04/18 webui增加知识库选择功能
11
+ - 🚀 2023/04/18 修复推理预测超时5s报错问题
12
+ - 🎉 2023/04/17 支持多种文档上传与内容解析:pdf、docx,ppt等
13
+ - 🎉 2023/04/17 支持知识增量更新
14
 
15
  [//]: # (- 支持检索结果与LLM生成结果对比)
16
 
requirements.txt CHANGED
@@ -1,9 +1,153 @@
1
- unstructured[local-inference]
2
- layoutparser[layoutmodels,tesseract]
3
- nltk
4
- sentence-transformers
5
- beautifulsoup4
6
- icetk
7
- cpm_kernels
8
- faiss-cpu
9
- gradio
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ aiofiles==23.1.0
2
+ aiohttp==3.8.4
3
+ aiosignal==1.3.1
4
+ altair==4.2.2
5
+ antlr4-python3-runtime==4.9.3
6
+ anyio==3.6.2
7
+ argilla==1.6.0
8
+ async-timeout==4.0.2
9
+ attrs==23.1.0
10
+ backoff==2.2.1
11
+ beautifulsoup4==4.12.2
12
+ brotlipy==0.7.0
13
+ cachetools==5.3.0
14
+ cchardet==2.1.7
15
+ certifi
16
+ cffi
17
+ chardet==5.1.0
18
+ charset-normalizer==3.1.0
19
+ click==8.1.3
20
+ coloredlogs==15.0.1
21
+ commonmark==0.9.1
22
+ contourpy==1.0.7
23
+ cpm-kernels==1.0.11
24
+ cryptography
25
+ cycler==0.11.0
26
+ dataclasses-json==0.5.7
27
+ Deprecated==1.2.13
28
+ effdet==0.3.0
29
+ entrypoints==0.4
30
+ et-xmlfile==1.1.0
31
+ faiss-gpu==1.7.2
32
+ fastapi==0.95.1
33
+ ffmpy==0.3.0
34
+ filelock==3.11.0
35
+ flatbuffers==23.3.3
36
+ flit_core
37
+ fonttools==4.39.3
38
+ frozenlist==1.3.3
39
+ fsspec==2023.4.0
40
+ gmpy2
41
+ gptcache==0.1.14
42
+ gradio==3.27.0
43
+ gradio_client==0.1.3
44
+ greenlet==2.0.2
45
+ h11==0.14.0
46
+ httpcore==0.16.3
47
+ httpx==0.23.3
48
+ huggingface-hub==0.13.4
49
+ humanfriendly==10.0
50
+ icetk==0.0.7
51
+ idna
52
+ iopath==0.1.10
53
+ Jinja2
54
+ joblib==1.2.0
55
+ jsonschema==4.17.3
56
+ kiwisolver==1.4.4
57
+ langchain==0.0.142
58
+ layoutparser==0.3.4
59
+ linkify-it-py==2.0.0
60
+ lxml==4.9.2
61
+ Markdown==3.4.3
62
+ markdown-it-py==2.2.0
63
+ MarkupSafe==2.1.2
64
+ marshmallow==3.19.0
65
+ marshmallow-enum==1.5.1
66
+ matplotlib==3.7.1
67
+ mdit-py-plugins==0.3.3
68
+ mdurl==0.1.2
69
+ mkl-fft==1.3.1
70
+ mkl-random
71
+ mkl-service==2.4.0
72
+ monotonic==1.6
73
+ mpmath==1.2.1
74
+ msg-parser==1.2.0
75
+ multidict==6.0.4
76
+ mypy-extensions==1.0.0
77
+ networkx
78
+ nltk==3.8.1
79
+ numexpr==2.8.4
80
+ numpy
81
+ olefile==0.46
82
+ omegaconf==2.3.0
83
+ onnxruntime==1.14.1
84
+ openai==0.27.4
85
+ openapi-schema-pydantic==1.2.4
86
+ opencv-python==4.6.0.66
87
+ openpyxl==3.1.2
88
+ orjson==3.8.10
89
+ packaging==23.1
90
+ pandas==1.5.3
91
+ pdf2image==1.16.3
92
+ pdfminer.six==20221105
93
+ pdfplumber==0.9.0
94
+ Pillow==9.5.0
95
+ portalocker==2.7.0
96
+ protobuf==3.18.3
97
+ pycocotools==2.0.6
98
+ pycparser
99
+ pydantic==1.10.7
100
+ pydub==0.25.1
101
+ Pygments==2.15.0
102
+ pyOpenSSL
103
+ pypandoc==1.11
104
+ pyparsing==3.0.9
105
+ pyrsistent==0.19.3
106
+ PySocks
107
+ pytesseract==0.3.10
108
+ python-dateutil==2.8.2
109
+ python-docx==0.8.11
110
+ python-magic==0.4.27
111
+ python-multipart==0.0.6
112
+ python-pptx==0.6.21
113
+ pytz==2023.3
114
+ PyYAML==6.0
115
+ regex==2023.3.23
116
+ requests==2.28.2
117
+ rfc3986==1.5.0
118
+ rich==13.0.1
119
+ scikit-learn==1.2.2
120
+ scipy==1.10.1
121
+ semantic-version==2.10.0
122
+ sentence-transformers==2.2.2
123
+ sentencepiece==0.1.98
124
+ six
125
+ sniffio==1.3.0
126
+ soupsieve==2.4.1
127
+ SQLAlchemy==1.4.47
128
+ starlette==0.26.1
129
+ sympy
130
+ tenacity==8.2.2
131
+ threadpoolctl==3.1.0
132
+ timm==0.6.13
133
+ tokenizers==0.13.3
134
+ toolz==0.12.0
135
+ torch==2.0.0
136
+ torchaudio==2.0.0
137
+ torchvision==0.15.0
138
+ tqdm==4.65.0
139
+ transformers==4.28.1
140
+ triton==2.0.0
141
+ typing-inspect==0.8.0
142
+ typing_extensions==4.5.0
143
+ tzdata==2023.3
144
+ uc-micro-py==1.0.1
145
+ unstructured==0.5.12
146
+ unstructured-inference==0.3.2
147
+ urllib3
148
+ uvicorn==0.21.1
149
+ Wand==0.6.11
150
+ websockets==11.0.2
151
+ wrapt==1.14.1
152
+ XlsxWriter==3.1.0
153
+ yarl==1.8.2