README.md

---
license: llama2
metrics:
- code_eval
library_name: transformers
tags:
- code
model-index:
- name: DataLinguistic-34B-V1.0
  results:
  - task:
      type: text-generation
    dataset:
      type: openai_humaneval
      name: HumanEval
    metrics:
    - name: pass@1
      type: pass@1
      value: 0.701
      verified: false


---

# DataLinguistic-34B-V1.0 Chinese-English Question Answering Model

## Model Overview

DataLinguistic-34B-V1.0 is a Chinese-English question answering model fine-tuned from Huggingface's CodeLlama-34b model with 4-bit quantization on DataLinguistic's proprietary datasets.

## Model Architecture 

DataLinguistic-34B-4bit-V1.0 inherits the encoder-decoder structure from Llama with 34B parameters. 

## Training Datasets

The model was trained on the following open-source datasets:

- Data_OpenSet: Chinese-English question-answering dataset curated from junelee/wizard_vicuna_70k
- Data_OpenSet2: Chinese-English question-answering dataset curated from garage-bAInd/Open-Platypus
- Proprietary Chinese-English question-answering dataset collected internally by DataLinguistic (not open-sourced)

The data is formatted as:
""


\<s>please answer my question in datalynn model and Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response: {question}\</s>


## Use Cases

The model can be used for a wide range of Chinese-English question answering and chatbot applications.

## Model Advantages

- Based on huge model CodeLlama-34b with 34B parameters
- Fine-tuned on large-scale Chinese-English QA datasets for high quality

## Usage

1. Install model from Huggingface
2. Import and initialize model
3. Input question, generate answer

## Version

Current version: DataLinguistic-34B-V1.0

## Author

Tang Zhengzheng

## Contributors

DataLinguistic team

# DataLinguistic-34B-V1.0 中英文问答模型

## 模型简介

DataLinguistic-34B-V1.0是一个基于Huggingface的CodeLlama-34b模型在DataLinguistic自建数据集上微调的中文英文问答模型。

## 模型结构

DataLinguistic-34B-V1.0 inherits the encoder-decoder structure from CodeLlama with 34B parameters.

## 模型训练数据集

模型使用了以下开源数据集进行了训练:

- Data_OpenSet: 基于junelee/wizard_vicuna_70k整理的中英文问答数据集
- Data_OpenSet2: 基于garage-bAInd/Open-Platypus整理的中英文问答数据集
- DataLinguistic内部收集的专属中英文问答数据集(未开源)

数据集采用如下格式:

\<s>please answer my question in datalynn model and Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response: {question}\</s>

## 应用场景

该模型可广泛应用于中英文问答、聊天机器人等场景。

## 模型优势 

- 基于大模型Llama-34b,参数量达34亿
- 在大规模中英文问答数据集上进行微调,质量较高

## 使用步骤

1. 在Huggingface安装模型
2. 导入并初始化模型
3. 输入问题,生成回答

## 版本信息

当前版本:DataLinguistic-34B-V1.0

## 作者

唐正正

## 贡献者

DataLinguistic团队