Spaces:

pdltiet
/

demo-gpu

Running on Zero

PyroSama commited on 8 days ago

Commit

c92b2c9

•

1 Parent(s): 4f07836

Update utils.py

Files changed (1) hide show

utils.py CHANGED Viewed

@@ -192,7 +192,7 @@ def read_file(data: str) -> Document:
     doc = Document(page_content=content, metadata={"name": data.split('/')[-1]})
     return doc
-text_splitter = RecursiveCharacterTextSplitter(chunk_size=800, chunk_overlap=100)
 def add_doc(data,vectorstore):
     doc = read_file(data)

     doc = Document(page_content=content, metadata={"name": data.split('/')[-1]})
     return doc
+text_splitter = RecursiveCharacterTextSplitter(chunk_size=2000, chunk_overlap=400)
 def add_doc(data,vectorstore):
     doc = read_file(data)