Upload Qwen2ForCausalLM

Finetuned on arabic data - 100%

README.md

@@ -1,202 +1,3 @@
----
-license: apache-2.0
----
----
-library_name: transformers
-tags: []
----
-
-# Model Card for Model ID
-
-<!-- Provide a quick summary of what the model is/does. -->
-
-
-
-## Model Details
-
-### Model Description
-
-<!-- Provide a longer summary of what this model is. -->
-
-This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
-
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
-
-### Model Sources [optional]
-
-<!-- Provide the basic links for the model. -->
-
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
-
-## Uses
-
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
-
-### Direct Use
-
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-
-[More Information Needed]
-
-### Downstream Use [optional]
-
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-
-[More Information Needed]
-
-### Out-of-Scope Use
-
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-
-[More Information Needed]
-
-## Bias, Risks, and Limitations
-
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-
-[More Information Needed]
-
-### Recommendations
-
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-
-## How to Get Started with the Model
-
-Use the code below to get started with the model.
-
-[More Information Needed]
-
-## Training Details
-
-### Training Data
-
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-
-[More Information Needed]
-
-### Training Procedure
-
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-
-#### Preprocessing [optional]
-
-[More Information Needed]
-
-
-#### Training Hyperparameters
-
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-
-#### Speeds, Sizes, Times [optional]
-
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-
-[More Information Needed]
-
-## Evaluation
-
-<!-- This section describes the evaluation protocols and provides the results. -->
-
-### Testing Data, Factors & Metrics
-
-#### Testing Data
-
-<!-- This should link to a Dataset Card if possible. -->
-
-[More Information Needed]
-
-#### Factors
-
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-
-[More Information Needed]
-
-#### Metrics
-
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-
-[More Information Needed]
-
-### Results
-
-[More Information Needed]
-
-#### Summary
-
-
-
-## Model Examination [optional]
-
-<!-- Relevant interpretability work for the model goes here -->
-
-[More Information Needed]
-
-## Environmental Impact
-
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-
-## Technical Specifications [optional]
-
-### Model Architecture and Objective
-
-[More Information Needed]
-
-### Compute Infrastructure
-
-[More Information Needed]
-
-#### Hardware
-
-[More Information Needed]
-
-#### Software
-
-[More Information Needed]
-
-## Citation [optional]
-
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-
-**BibTeX:**
-
-[More Information Needed]
-
-**APA:**
-
-[More Information Needed]
-
-## Glossary [optional]
-
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-
-[More Information Needed]
-
-## More Information [optional]
-
-[More Information Needed]
-
-## Model Card Authors [optional]
-
-[More Information Needed]
-
-## Model Card Contact
-
-[More Information Needed]
+---
+license: apache-2.0
+---

config.json

@@ -0,0 +1,27 @@
+{
+  "_name_or_path": "airev-ai/Jais-Inception-70b-V1.2.2",
+  "architectures": [
+    "Qwen2ForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "eos_token_id": 151645,
+  "hidden_act": "silu",
+  "hidden_size": 8192,
+  "initializer_range": 0.02,
+  "intermediate_size": 29568,
+  "max_position_embeddings": 131072,
+  "max_window_layers": 28,
+  "model_type": "qwen2",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 80,
+  "num_key_value_heads": 8,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 1000000.0,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float16",
+  "transformers_version": "4.43.3",
+  "use_cache": false,
+  "use_sliding_window": false,
+  "vocab_size": 152064
+}

generation_config.json

@@ -0,0 +1,7 @@
+{
+  "bos_token_id": 151643,
+  "do_sample": true,
+  "eos_token_id": 151643,
+  "max_new_tokens": 2048,
+  "transformers_version": "4.43.3"
+}

model-00001-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0176936410ae77d886b3e1ec011b0d7de259fd6f78113232a18375958855a090
+size 2491416712

model-00002-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef68ae215efd367fdcbdd4e615e178396137a2b493754e4419f6210d109365a1
+size 1923164168

model-00003-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:42f166fc48d020898a83c8b1ec88c884a6eafdf468818f9b1d71eec9a45a9f07
+size 1889588696

model-00004-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:22b009a58649fb847241fb2d9c94b246941cdf85db453494df3bdea04498bd38
+size 1755370856

model-00005-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d97a6664aa615bcfc93bc67efdcda9de434c1db7184df383a2a499e4ddc5d86
+size 1755370856

model-00006-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:92f8d282df6925a1b2fc187369544afab9423c8a860fb766077376abe4961773
+size 1755370856

model-00007-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:862ccc02a93239290781290633b0d5cc52eb199b5032bfc467e0bee711ae4cab
+size 1755370856

model-00008-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c59d9670d7b18374dfbf6735d0db1c461cd5a7d13cdbbf877f3c16830c1ac926
+size 1755370856

model-00009-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:60c3ee634bb337c0491a0b55cb213fe1174175d8d4080b4f007e3834eae6d40d
+size 1755370856

model-00010-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71b9b31c2ec6f20075c6a33ddbbc7ff4dcf02d07b1887b385025777927805fd2
+size 1755370856

model-00011-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c2b3514b4837a2320586f050b8a67ee8e37bbe4cf51f99ec7a27c828157b3c61
+size 1755370840

model-00012-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d42d107f06fcfcb69b90dd0ab736526afc83695292db92eab37822b56af44258
+size 1755370864

model-00013-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea2ebd82520107c822ca1f7c31e2e57b60fbb9fc6f68b887704d8ea1a52e0133
+size 1755370864

model-00014-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1bc1ae53931f1995f88a32a099f14f49435c6f75167a3a6941a291e69202dac0
+size 1755370864

model-00015-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:794e2f93b5beca7328a72525a909adf7d4c45770f882bc6b0b01523b04b1460b
+size 1755370864

model-00016-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f7b61af2cc03bbc7a1116c3a98610ec5f1edf6884fd097e280d7f6c874228e75
+size 1755370864

model-00017-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72d809e6a7e672526239232a81e9ccf8c54e060bf72fea4ab25d894bd31245d5
+size 1755370864

model-00018-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26d5f8d7f50eed8b56329da693b019a0e1409480ab07c030769520370ade5bee
+size 1755370864

model-00019-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a5e28d550ecb7042d26d662e577e79347b79a27c9fd87ae5e80d7752ef46853f
+size 1755370864

model-00020-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3be50ee6dd5752cdb2242afaadfdd6553652b3366ebb24b5ed018f6dff023ad0
+size 1755370864

model-00021-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10f05e3901831ebed960521ceaa550fafad45b9e8477fbddd91bfc3867ec2115
+size 1755370864

model-00022-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d4683ab50f63524aeee2fae0bf9c2cdec6776265dd8a7062defdc70cb9ed2f29
+size 1755370864

model-00023-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cf1894109ba67c985ce47d0dc468d23b6cff9df1aabae3a7498138af29b4a081
+size 1755370864

model-00024-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:968d251442eb163a39998577738551c3dbb259886b7a7c5d0c8093a55d498fa8
+size 1755370864

model-00025-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f72a43531a3737c99a76c806f0844fd6c231adce7d26de09d3febd01e31f7bfe
+size 1755370864

model-00026-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72d73dff5e7bdeb5481574635647e0ba252e74c719c8917dd37405c78dadcc64
+size 1755370864

model-00027-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd8e236a24c3b56fa2578687a628641f8ea6634eaab0e7b42f71b50044de125b
+size 1755370864

model-00028-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ba64fa2a79e3e96caff19c833a7882ac7b6aa750134ef199492485473c8ac66
+size 1755370864

model-00029-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c328066d391b853e32d97082ae8a6a58978fe64b9f83a62c6192e2d61a8a4a5e
+size 1755370864

model-00030-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ba618e08409a7193761b1735c25db69578a05ef0d70f54f97995eb002dbe2e49
+size 1755370864

model-00031-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:53fa3171698027d2f77d4df8866c223a072e0aaf52d5031e4866508a3435c30d
+size 1755370864

model-00032-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b99f0acd5bd08e144c3fa140de4211c413e7e39f575d48beedb225a22ddfd569
+size 1755370864

model-00033-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c88074b5b9c841228b6761cf9645d5d09c9042ac799071f931784567b3f41657
+size 1755370864

model-00034-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:701e831956e52e12a3e543f66b0584af1ca3ca483fe2e4e733ea137fd73d5d19
+size 1755370864

model-00035-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1dabfae952dd2ad0932a7d0fd5f4b0c16f601af18e1fd8287f37b5daf47198d3
+size 1755370864

model-00036-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7514691510a321aac87a8ac993015be8b307017f9cbd96caf7f02f463a68ff77
+size 1755370864

model-00037-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b46514688f2011e9909614bd15f35664171d3a92b61c7595cd65c1708c57bbd1
+size 1755370864

model-00038-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2eb43ff02316e9dd277d2b2a006bdf8f08bbc8d8fa5fc6c0893dd5ca88a68316
+size 1755370864

model-00039-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a42c7053ff76adf5992dae67004d34963dcb8008d622b8c354f01f7052312955
+size 1755370864

model-00040-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b7970a2c8a32f146faeec7ca29273b6c073099fc19748ee5c8cfe6fe929ead5
+size 1755370864

model-00041-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1e1ba0962929da32b5b912d8c4fb123514413ec0ba1a93ed557e3cdcb6d7bf4
+size 1755370864

model-00042-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1cb927692fb628d2ea6280a5c326ea942690918a61757bb905b7a99aac4d1650
+size 1755370864

model-00043-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:589d1e9426285ef945a3e47a28487a8a68c1c11b0e1dfbd20f3d19925b386512
+size 1755370864

model-00044-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b0b08d78db56afe939c86113a0a84b1c89483d1f4231754fa3cb1a106432b5f
+size 1755370864

model-00045-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb43494d51f5c8e0858d5685c87d5f5221acfafbd0a37ccce1502ecc1e4e7a14
+size 1755370864

model-00046-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d74ebb61ee055d97b80101630374b16d131155084c1996415550978c782977a7
+size 1755370864

model-00047-of-00082.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a4efbc0260b31e72794231efa4102d43d4b805648fbf15a1f824d0216b7d0f8f
+size 1755370864