# Thai GPT Next

It is fine-tune the GPT-Neo model for Thai language.

GitHub: https://github.com/wannaphong/thaigpt-next

**Dataset for fine-tune this model**

- prachathai67k
- thaisum
- thai_toxicity_tweet
- wongnai reviews
- wisesight_sentiment
- TLC
- scb_mt_enth_2020 (Thai only)
- Thai wikipedia (date: 2021/06/20)

**Max Length:** 280

**Number of train lists**: 1,697,254 lists

**Number of training**: 2 ep

**training loss**: 0.285500

## Model

- thaigpt-next-125m is fine-tune the GPT-NEO-125M model.

## How to use

You can using it from huggingface or PyThaiNLP (in the future) for few-shot learning works or text generation (not recommended).

thaigpt-next-125m at huggingface model: https://huggingface.co/wannaphong/thaigpt-next-125m

## License

>    Copyright 2021 Wannaphong Phatthiyaphaibun
>
>    Licensed under the Apache License, Version 2.0 (the "License");
>    you may not use this file except in compliance with the License.
>    You may obtain a copy of the License at
>
>        http://www.apache.org/licenses/LICENSE-2.0
>
>    Unless required by applicable law or agreed to in writing, software
>    distributed under the License is distributed on an "AS IS" BASIS,
>    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
>    See the License for the specific language governing permissions and
>    limitations under the License.

## Author

Wannaphong Phatthiyaphaibun