Package: e2eqavn
1. Introductione2eqavnis a 'simple' and 'easy to use' library that provides end to end pipeline for Question answering task.e2eqavnbuild on Pytorch and provide command lined interface that allow user to train, test, and evaluate pipline.2. Installationpip install -U e2eqavn3. Command line interfaceCommandFunctione2eqavn train- Training a modele2eqavn evaluate- Evaluate the performance of a modele2eqavn test- Performs the inference of a text input3.1 Training modele2eqavn train --config [path_config_file]This command starts a training pipeline that consists of retrieval or machine reading comprehension or both. If you want to train, you must provide path config yaml file. In this file config, you must setup the mode for training.Example config file:retrieval:
    is_train: true # turn on mode training retrieval
.....

reader:
    is_train: true # turn on mode training readerYou can see more detail parameter config in thislinkArguments:Requiredarguments:--configCONFIG_FILE,-cCONFIG_FILEPathtotheconfigfile(architecturemodel,hyperparameter,..)Optionalarguments:--help,-hShowthishelpmessageandexit.Example training CLIe2eqavn train --config config.yaml3.2 Evaluate pipelinee2eqavn evaluate [MODE] --config [path_config_file] 
                        --top_k_bm25 [INT_VALUE] # Optional, default value 10
                        --top_k_sbert [INT_VALUE] # Optional, default value 3
 
 
    MODE must in:
        - retrieval: Evaluate retrieval
        - reader: Evaluate reader
        - pipeline: Evalaute pipeline(retrieval + reader)This command enable user to evaluate model in 3 ways:Retrieval model: Calculate recall@k, precision@k, ndcg metric and log result to csv fileReader model: Calculate 2 metrics: Exact match, F1 for machine reading comprehension taskPipeline model: Evaluate performance pipeline in Exact match and F1 scoreArguments:Requiredarguments:MODESelectionmodeforevalaute(retrieval,reader,pipeline)--configCONFIG_FILEPathtotheconfigfile.--top_k_bm25TOP_K_BM25TopkdocumentwhenretreivalbyBM25algorithm--top_k_sbertTOP_K_SBERTTopkdocumentwhenretrievalbySentenceTransformerAlgorithm--logging_result_pipelineLOGGING_RESULTLoggingresultpredicttojsonfilewhenmodeequalpipelineOptionalarguments:--help,-hShowthishelpmessageandexit.3.2 TestingThis command enable user for testing example with pipeline exist in locale2eqavn evaluate [MODE] --config [path_config_file] 
                        --question [STRING_QUESTION]  
                        --top_k_bm25 [INT_VALUE] # Optional, default value 10
                        --top_k_sbert [INT_VALUE] # Optional, default value 3
                        --top_k_qa [INT_VALUE] # Optional, default value 1
 
 
    MODE must in:
        - retrieval: Evaluate retrieval
        - reader: Evaluate reader
        - pipeline: Evalaute pipeline(retrieval + reader)Arguments:Requiredarguments:MODESelectionmodeforevalaute(retrieval,reader,pipeline)--configCONFIG_FILEPathtotheconfigfile.--questionQUESTIONWhichquestiondoyouwanttoask?--top_k_bm25TOP_K_BM25TopkdocumentwhenretreivalbyBM25algorithm--top_k_sbertTOP_K_SBERTTopkdocumentwhenretrievalbySentenceTransformerAlgorithm--top_k_qaTOP_K_QATopkmrcresultOptionalarguments:--help,-hShowthishelpmessageandexit.