Spaces:
Sleeping
Sleeping
File size: 1,233 Bytes
a8158b1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
# π Notebooks
Jupyter/Colab notebooks to create the Search pipeline and generate questions, using [ π Haystack](https://github.com/deepset-ai/haystack).
## [Indexing and pipeline creation](./indexing_and_pipeline_creation.ipynb)
This notebook is inspired by ["Build Your First QA System" tutorial](https://haystack.deepset.ai/tutorials/first-qa-system), from Haystack documentation.
Here we use a collection of articles about Twin Peaks to answer a variety of questions about that awesome TV series!
The following steps are performed:
- load and preprocess data
- create (FAISS) document store and write documents
- initialize retriever and generate document embeddings
- initialize reader
- compose and try Question Answering pipeline
- save and export (FAISS) index
## [Question generation](./question_generation.ipynb)
This notebook is inspired by [Question Generation tutorial](https://haystack.deepset.ai/tutorials/question-generation), from Haystack documentation.
Here we use a collection of articles about Twin Peaks to generate a variety of questions about that awesome TV series!
The following steps are performed:
- load data
- create document store and write documents
- generate questions and save them
|