Text Generation
Transformers
PyTorch
English
llama
text-generation-inference
Inference Endpoints
dwadden commited on
Commit
c23a2fd
1 Parent(s): d86956d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - allenai/SciRIFF-train-mix
5
+ - allenai/tulu-v2-sft-mixture
6
+ language:
7
+ - en
8
+ ---
9
+ # Model Card for SciTulu 70B
10
+
11
+ SciTulu is a collection of instruction-following language models targeting scientific literature understanding use cases. Starting from the [Tulu v2 70B](https://huggingface.co/allenai/tulu-2-70b) model, SciTulu is trained on a mix of science-specific demonstrations from the [SciRIFF dataset](https://huggingface.co/datasets/allenai/SciRIFF-train-mix), together with general-domain instructions from the [Tulu v2 SFT mix](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture). SciTulu 70B achives a 6.5% average improvement over Tulu v2 70B on nine held-out scientific literature understanding tasks. More information can be found in our preprint: [SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature](https://arxiv.org/abs/2406.07835).
12
+
13
+ Training and evaluation code for SciTulu is available in our GitHub repository: https://github.com/allenai/SciRIFF.
14
+
15
+ See the [Tulu model card](https://huggingface.co/allenai/tulu-2-70b) for more information on potential risks, biases, and limitations.