Repository: huggingface/tokenizers (language: rust)

Issue:
"make bench" command does not download all required resources
Hi!

I checked out the repo on the `main` branch with `f1c23b868006ee27acdd31796677f82fa10d6bd7` commit, `cd`-ed to `tokenizers` directory, and ran `make bench` command. Instead of successful benchmark run, I got the following error:

```
     Running benches/layout_benchmark.rs (target/release/deps/layout_benchmark-1f68f2f9387775b7)
thread 'main' panicked at benches/layout_benchmark.rs:28:80:
called `Result::unwrap()` on an `Err` value: Os { code: 2, kind: NotFound, message: "No such file or directory" }
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
error: bench failed, to rerun pass `--bench layout_benchmark`
```

The reason is that `make bench` command does not download Albert test resource for `layout_benchmark` referenced [here](https://github.com/huggingface/tokenizers/blob/main/tokenizers/benches/layout_benchmark.rs#L28).

It could be fixed locally by running `make test` before `make bench` - it downloads all required files. But I think it should be fixed in another way - `make bench` command should be isolated and download all required test files.


Discussion / hints:

Fix patch:
diff --git a/tokenizers/Makefile b/tokenizers/Makefile
index 486f5a568..a407afffc 100644
--- a/tokenizers/Makefile
+++ b/tokenizers/Makefile
@@ -4,9 +4,9 @@ TESTS_DIR = tests
 
 dir_guard=@mkdir -p $(@D)
 
-SHARED_RESOURCES = $(DATA_DIR)/gpt2-vocab.json $(DATA_DIR)/gpt2-merges.txt $(DATA_DIR)/bert-base-uncased-vocab.txt $(DATA_DIR)/big.txt $(DATA_DIR)/small.txt
+SHARED_RESOURCES = $(DATA_DIR)/gpt2-vocab.json $(DATA_DIR)/gpt2-merges.txt $(DATA_DIR)/bert-base-uncased-vocab.txt $(DATA_DIR)/big.txt $(DATA_DIR)/small.txt $(DATA_DIR)/albert-base-v1-tokenizer.json 
 BENCHMARK_RESOURCES = $(SHARED_RESOURCES)
-TESTS_RESOURCES = $(SHARED_RESOURCES) $(DATA_DIR)/unigram.json $(DATA_DIR)/unigram_wagahaiwa_nekodearu.txt $(DATA_DIR)/albert-base-v1-tokenizer.json $(DATA_DIR)/roberta.json $(DATA_DIR)/tokenizer-wiki.json $(DATA_DIR)/bert-wiki.json
+TESTS_RESOURCES = $(SHARED_RESOURCES) $(DATA_DIR)/unigram.json $(DATA_DIR)/unigram_wagahaiwa_nekodearu.txt $(DATA_DIR)/roberta.json $(DATA_DIR)/tokenizer-wiki.json $(DATA_DIR)/bert-wiki.json
 
 .PHONY : build
 build :


Test patch: