FacebookAI/roberta-base · Add tokenizer_config.json and special_tokens

Add tokenizer_config.json and special_tokens_map.json

by Xenova HF staff - opened Apr 27, 2023

base: refs/heads/main

←

from: refs/pr/7

Discussion Files changed

+30

-0

Xenova

Apr 27, 2023

No description provided.

Fix malformed tokenizer_config and add special_tokens_map.jsonc8b8a37c

Xenova changed pull request title from Fix malformed tokenizer_config and add special_tokens_map.json to Add tokenizer_config.json and special_tokens_map.json Apr 27, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Cannot merge

This branch has merge conflicts in the following files:

tokenizer_config.json

· Sign up or log in to comment