init

README.md

@@ -0,0 +1,67 @@
+---
+license: apache-2.0
+language:
+- en
+pipeline_tag: text-generation
+tags:
+- math
+- lean
+---
+
+# **morph-prover-v0-7b**
+
+![banner](https://pbs.twimg.com/profile_images/1669255916980686848/mTW-mxbC_400x400.jpg)
+
+
+## Table of Contents
+
+
+1. **<a href="https://huggingface.co/morph-labs/morph-prover-v0-7b#model-summary" target="_blank">Model Summary</a>**
+2. **<a href="https://huggingface.co/morph-labs/morph-prover-v0-7b#blog-post" target="_blank">Blog Post</a>**
+3. **<a href="https://huggingface.co/morph-labs/morph-prover-v0-7b#training-format" target="_blank">Training Format</a>**
+4. **<a href="https://huggingface.co/morph-labs/morph-prover-v0-7b#sign-up-for-hosted-use" target="_blank">Sign Up for Hosted Use</a>**
+5. **<a href="https://huggingface.co/morph-labs/morph-prover-v0-7b#citation" target="_blank">Citation</a>**
+6. **<a href="https://huggingface.co/morph-labs/morph-prover-v0-7b#ethical-considerations-and-limitations" target="_blank">Ethical Considerations & Limitations</a>**
+
+
+
+# **Model Summary**
+
+- **Developed by:** **<a href="https://www.morph.so" target="_blank">Morph Labs</a>**
+- **Language(s) (NLP):** English.
+- **License:** **<a href="https://www.apache.org/licenses/LICENSE-2.0" target="_blank">Apache 2.0</a>**
+
+Morph Prover v0 7B, the first open-source model trained as a conversational assistant for Lean users. This model was trained in collaboration with **<a href="https://nousresearch.com/" target="_blank">Nous Research</a>** and the **<a href="https://cs.stanford.edu/~sanmi/" target="_blank">Safe and Trustworthy AI Research (STAIR) group at Stanford</a>** led by professor Sanmi Koyejo, with major contributions by Brando Miranda of Stanford and help from Peter Holderrieth of MIT and Jin Peng Zhou of Cornell. Thanks to **<a href="https://huggingface.co/nomic-ai" target="_blank">Nomic AI's</a>** GPT4All Vulkan support, this model can run on any consumer GPU. Morph Prover v0 7B is a chat fine-tune of **<a href="https://huggingface.co/mistralai/Mistral-7B-v0.1" target="_blank">Mistral 7B</a>** which achieves state of the art results in autoformalization while performing better than the original Mistral model on benchmarks like AGIEval and MMLU. It was trained with a proprietary synthetic data pipeline with code data generated by the **<a href="https://github.com/morph-labs/mci" target="_blank">Morph Code Index</a>**.
+
+
+## Blog Post
+
+**https://morph.so/blog/the-personal-ai-proof-engineer/**
+
+
+## Training Format
+
+The model was trained for chat using the Llama 2 chat format. Example as follows:
+
+```
+[INST] <<SYS>>\n You are a helpful assistant. \n<</SYS>>\n\n  What is the curry howard isomorphism? [/INST]
+```
+
+
+## Sign Up for Hosted Use
+
+**<a href="https://forms.gle/vr28p6dQCJuRVLAE6" target="_blank">Sign Up Form</a>**
+
+
+## Citation
+
+@misc{morphprover2023,
+      title={Morph Prover v0 7B: the first open-source chat assistant for Lean}, 
+      author={Morph Labs, Jesse Michael Han, Eric Yu, Bentley Long, Pranav Mital, Brando Miranda, Peter Holderrieth, Jin Peng Zhou, Sanmi Koyejo},
+      year={2023},
+}
+
+
+## Ethical Considerations and Limitations
+
+Morph Prover v0 7B, as with all Large Language Models, carries inherent risks with use. Testing has been solely conducted in English, and our testing has not been fully comprehensive nor could be fully comprehensive of all use scenarios. The model may be prone to producing inaccurate, unsatisfactory, or otherwise undesirable outputs, and thus we encourage all developers to test and tune to their specific use case prior to deployment.

added_tokens.json

@@ -0,0 +1 @@
+{}

config.json

@@ -0,0 +1,26 @@
+{
+  "_name_or_path": "mistralai/Mistral-7B-v0.1",
+  "architectures": [
+    "MistralForCausalLM"
+  ],
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "init_device": "cuda:7",
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 32768,
+  "model_type": "mistral",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 8,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 10000.0,
+  "sliding_window": 4096,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.34.0",
+  "use_cache": true,
+  "vocab_size": 32000
+}

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "transformers_version": "4.34.0"
+}

model-00001-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e84cafb4e75d94893f19736d5ea14283421a308445e549952eafad49316d2f05
+size 262144136

model-00002-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f16dc3226ee2e42483285d831d83ceca5c1b4b219ca0feb3ec66f7331d92c9ab
+size 33554584

model-00003-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2807066ff27458ba1e6d1304599991faa1fac4fbe1a1d8e3fe52f2b54e99a887
+size 8388760

model-00004-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b50f89f884b86cf28935eec66677956e99b2a7d41d069588a007aa6aca86159a
+size 8388760

model-00005-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3ac614968547326eb09134cef5b70dcefd2a68fe62e261e863b6f7841248e0f
+size 33554584

model-00006-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2fdb0c431f2a77d7622ef7fbffc401a9fb6cb0175393d744a302529c5f6e435c
+size 117440664

model-00007-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:23cfe70e4acc8cbde3b2e952e6ca5b91a0f4fb498e173fd99ddf1b867803ecd6
+size 117440656

model-00008-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:514ec61d171ffabbec6108ac6a884c7674df78a23b9eb7e7f61adba2ec053bac
+size 117440664

model-00009-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8bd9845146299c1a9bdc389bb0c6626efca349974d5dd309655f57766ec22c3
+size 8328

model-00010-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:686b7969c8d177fa408d67c52b380b65e5acf96269ce80967a438646e6a31193
+size 8344

model-00011-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:752e009cada28305fd2a481223747600a29f66ce42ba5d43ce585ac60b37b850
+size 33554584

model-00012-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:42aa29084827647a0e8217066336cab958ff9b0c963f177fe6e9c3c674d1750f
+size 8388760

model-00013-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33f819f0f0af921315c9a3af5479c4685aa39afdc222e1a8c98e7acca3e3788f
+size 8388760

model-00014-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:057a1fe26be1d681836e7f44635991908b7a4088b8d4d54f30549ca3152a4196
+size 33554584

model-00015-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ba45fad965bed525d3684515e4191bed963d7d154a1129724b3bd5f3112ee49b
+size 117440664

model-00016-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e1fd5b822a587e117b5a24a9adb5aca609a3ef67822d6e6fd98fff898d81d2aa
+size 117440656

model-00017-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a518a16e74f1dc0995b96631a4994c448381a88788c734cfb7e11ea40a5e89a0
+size 117440664

model-00018-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:429671cdd1af6aa9efe2b0908de179f5443f1835056e671ac0d4ef844a48e6a3
+size 8328

model-00019-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:03fac4dcae041698e9b85bd2e2d49d53da3b64bddd9a7addc2f5397d65968423
+size 8344

model-00020-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cecfd7c6a8684a018a9636660572d4afd5e33dc52275afe00bb7ad91082b40c2
+size 33554584

model-00021-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc205719a4b3649f027925b4579a8dbce7bfb5ee34dd7bcca9f1710b8dfbe8c9
+size 8388760

model-00022-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e98e27c0d4caf2738f0e3097c47b65c58ab2da1914c3ccf5e564e6491785438d
+size 8388760

model-00023-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86313fce3468a6f253baa6d2617e2215cbab8649857f29f5e7cfabf9ee0cb61c
+size 33554584

model-00024-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0071d211b3629dd1f71351cb307610c6e423b1d22ecc2ac336506f41df193b56
+size 117440664

model-00025-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc4c72e5597de6e5dcdaff8a2cb8e21f070006d23bdfebdb784cf1346f13a675
+size 117440656

model-00026-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b1bce9f34629c4d5d50c7ea23ee419199ba30e71504606077fc9dbead33eaed
+size 117440664

model-00027-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5838b6a4328b8f341b62259e47515b752eb9220e0de40e6c8b19fd65c0400abf
+size 8328

model-00028-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d95353f01231e7807f3b75bbfc6ae193ae0cbee26a3447b0dcfdfa181f08229
+size 8344

model-00029-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d053961ab4d88024003a79917f8dfe0a6daac711540cd8059a34810e25c9838
+size 33554584

model-00030-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91ebd30e3701b9c8b5f7c0b8217a009f25f1063fbc0bb5f1a2de26b8c0c1b165
+size 8388760

model-00031-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9afac2b6e27f383fcd2de2d1f6f81809e46c16be16ea3c9f36a9a2ebc8348ef5
+size 8388760

model-00032-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eafb3fcadbc27556367f47623a8bf867feff3a076ace26b36893294c45d492ab
+size 33554584

model-00033-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:349addf8faf9ff364e849f4b02a7e3fb1402ced7a23e3e93491e6b6d0aec9bb7
+size 117440664

model-00034-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd592192586d5e17d8626e2915a7c7a7aca068d962f28e4f29c8adc48c16dc03
+size 117440656

model-00035-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:78687555b9476fec1013030598749e6c9d1e0c6a3693860242f6ae0b6c9218da
+size 117440664

model-00036-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:23ef6ab0a3b0ec5790290c7a1e704decee65dca58c8a372794cefdf371d8c928
+size 8328

model-00037-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:491a0ec57dbf7fc9464fd78340d90968f8b5f9c7b8e15bf48053da6d82b54f1c
+size 8344

model-00038-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0f564194b7617e6cbba0cc76aad642a1c31051bf3e47f21065909dd698e2baf
+size 33554584

model-00039-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:37c6fd7c8b8bc7f9a217d7be0b13a083e6a23b8f5d76b5b90eed9e02ce3b56d4
+size 8388760

model-00040-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:78b04e539f928e51fd3f3b32e8cdc9b6ef8b3ad0bd04e9c425c278568da41d15
+size 8388760

model-00041-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3fcb23c5a51e6824498e6b15236794051b7f7fdd09c960971910de670c2393d
+size 33554584

model-00042-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e30903ce5a0427e377afd4a17a94812f51ab7df77f5df75861ac2de7e2ca3589
+size 117440664

model-00043-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:192cfa77213a074c6718b8b0cff08ecff36485d953482696194af3c42fe3bc99
+size 117440656

model-00044-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3953a6b17fe4823da499baf0bebad2349ebe90d3cb2f9f15d97193996bd4c2ea
+size 117440664

model-00045-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f2a88bf2d2de15cb43ff025d3af4929f0ecfcba14a32f07d8e00378b78b322e
+size 8328

model-00046-of-00291.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:425a3d554c5737e578fb94e2cf932d08c9b527cc78f8df4454366849cf809060
+size 8344