INFO:root:Trying to use emilyalsentzer/Bio_ClinicalBERT as a pretrained BERT
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/tokenizer_config.json HTTP/1.1" 404 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/config.json HTTP/1.1" 200 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/tokenizer_config.json HTTP/1.1" 404 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/vocab.txt HTTP/1.1" 200 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/tokenizer.json HTTP/1.1" 404 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/added_tokens.json HTTP/1.1" 404 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/special_tokens_map.json HTTP/1.1" 404 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/tokenizer_config.json HTTP/1.1" 404 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/config.json HTTP/1.1" 200 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/config.json HTTP/1.1" 200 0
DEBUG:root:Reading in the data from ../data/disease-prediction
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/config.json HTTP/1.1" 200 0
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): huggingface.co:443
DEBUG:urllib3.connectionpool:https://huggingface.co:443 "HEAD /emilyalsentzer/Bio_ClinicalBERT/resolve/main/pytorch_model.bin HTTP/1.1" 302 0
DEBUG:root:Training the model...
INFO:root:Epoch Train Accuracy 0.0000
INFO:root:Test Accuracy 0.3585
INFO:root:Epoch 1, Loss 478.8906
INFO:root:Epoch Train Accuracy 0.0000
INFO:root:Test Accuracy 0.8751
INFO:root:Epoch 2, Loss 325.1406
INFO:root:Saved model files to model
INFO:root:Saved model at epoch 2
INFO:root:Epoch Train Accuracy 0.0000
INFO:root:Test Accuracy 0.9537
INFO:root:Epoch 3, Loss 189.3594
INFO:root:Epoch Train Accuracy 0.0000
INFO:root:Test Accuracy 0.9789
INFO:root:Epoch 4, Loss 112.4805