tmvec-cath / tm_vec_cath_model_params.json
valentynbez's picture
Upload 2 files
4371e6c verified
raw
history blame
181 Bytes
{
"d_model": 1024,
"nhead": 4,
"num_layers": 2,
"dim_feedforward": 2048,
"out_dim": 512,
"dropout": 0.1,
"activation": "relu",
"lr0": 0.0001,
"warmup_steps": 300
}