🚀 Models ⚡️ Inference API
🔥 Sign in
Back to all models
Model: fmikaelian/camembert-base-squad
pytorch camembert question-answering fr
question-answering mask_token: <mask>
Context
Query this model
🔥 This model is currently loaded and running on the Inference API. ⚠️ This model could not be loaded by the inference API. ⚠️ This model can be loaded on the Inference API on-demand.
JSON Output
API endpoint  

⚡️ Upgrade your account to access the Inference API 

							$
							curl -X POST \

								-H "Authorization: Bearer YOUR_ORG_OR_USER_API_TOKEN" \

							-H "Content-Type: application/json" \

								-d '{"question": "Where does she live?", "context": "She lives in Berlin."}' \

							https://api-inference.huggingface.co/models/fmikaelian/camembert-base-squad
Share Copied link to clipboard

Monthly model downloads

fmikaelian/camembert-base-squad fmikaelian/camembert-base-squad
115 downloads
last 30 days

pytorch

tf

Contributed by

fmikaelian Félix MIKAELIAN
3 models

How to use this model directly from the 🤗/transformers library: 

			
Copy to clipboard

			from transformers import AutoTokenizer, AutoModelForQuestionAnswering

			tokenizer = AutoTokenizer.from_pretrained("fmikaelian/camembert-base-squad")
			
			model = AutoModelForQuestionAnswering.from_pretrained("fmikaelian/camembert-base-squad")
List all files in model · See raw config file
Update on GitHub

camembert-base-squad

Description

A baseline model for question-answering in french (CamemBERT model fine-tuned on french-translated SQuAD 1.1 dataset)

Training hyperparameters

python3 ./examples/question-answering/run_squad.py \
--model_type camembert \
--model_name_or_path camembert-base \
--do_train \
--do_eval \
--do_lower_case \
--train_file SQuAD-v1.1-train_fr_ss999_awstart2_net.json \
--predict_file SQuAD-v1.1-dev_fr_ss999_awstart2_net.json \
--learning_rate 3e-5 \
--num_train_epochs 2 \
--max_seq_length 384 \
--doc_stride 128 \
--output_dir output3 \
--per_gpu_eval_batch_size=3 \
--per_gpu_train_batch_size=3 \
--save_steps 10000

Evaluation results

{"f1": 79.8570684959745, "exact_match": 59.21327108373895}

Usage

from transformers import pipeline

nlp = pipeline('question-answering', model='fmikaelian/camembert-base-squad', tokenizer='fmikaelian/camembert-base-squad')

nlp({
    'question': "Qui est Claude Monet?",
    'context': "Claude Monet, né le 14 novembre 1840 à Paris et mort le 5 décembre 1926 à Giverny, est un peintre français et l’un des fondateurs de l'impressionnisme."
})
List of model files
File name Last modified File size
config.json Fri, 24 Apr 2020 15:59:04 GMT 517.0B
pytorch_model.bin Sun, 01 Mar 2020 21:49:25 GMT 422.0MB
sentencepiece.bpe.model Sun, 01 Mar 2020 21:49:29 GMT 791.9KB
special_tokens_map.json Sun, 01 Mar 2020 21:49:24 GMT 210.0B
tokenizer_config.json Sun, 01 Mar 2020 21:49:29 GMT 23.0B
training_args.bin Sun, 01 Mar 2020 21:49:24 GMT 1.4KB
Done