Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
nreimers
/
BERT-Small-L-4_H-512_A-8
like
0
Feature Extraction
Transformers
PyTorch
JAX
bert
Inference Endpoints
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
0961f66
BERT-Small-L-4_H-512_A-8
/
README.md
nreimers
Model
0961f66
over 3 years ago
preview
code
|
raw
history
blame
No virus
183 Bytes
# BERT-Small-L-4
_H-512_
A-8
This is a port of the [
BERT-Small model
](
https://github.com/google-research/bert
) to Pytorch. It uses 4 layers, a hidden size of 512 and 8 attention heads.