File size: 1,233 Bytes
a8158b1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
# πŸ““ Notebooks
Jupyter/Colab notebooks to create the Search pipeline and generate questions, using [ πŸ” Haystack](https://github.com/deepset-ai/haystack).

## [Indexing and pipeline creation](./indexing_and_pipeline_creation.ipynb)

This notebook is inspired by ["Build Your First QA System" tutorial](https://haystack.deepset.ai/tutorials/first-qa-system), from Haystack documentation.

Here we use a collection of articles about Twin Peaks to answer a variety of questions about that awesome TV series!

The following steps are performed:
- load and preprocess data
- create (FAISS) document store and write documents
- initialize retriever and generate document embeddings
- initialize reader
- compose and try Question Answering pipeline
- save and export (FAISS) index

## [Question generation](./question_generation.ipynb)

This notebook is inspired by [Question Generation tutorial](https://haystack.deepset.ai/tutorials/question-generation), from Haystack documentation.

Here we use a collection of articles about Twin Peaks to generate a variety of questions about that awesome TV series!

The following steps are performed:

- load data
- create document store and write documents
- generate questions and save them