Model: freddiezhang/honor
Author: freddiezhang
Pipeline: text-classification
Library: transformers
Tags: transformers, pytorch, bert, text-classification, autotrain, en, dataset:freddiezhang/autotrain-data-honor, co2_eq_emissions, endpoints_compatible, region:us
Card metadata: tags: autotrain, text-classification
language: en
widget: text: Generative Pre-trained Transformer 3 (GPT-3) is an autoregressive language model that uses deep learning to produce human-like text. Given an initial text as prompt, it will produce text that continues the prompt.
The architecture is a standard transformer network (with a few engineering tweaks) with the unprecedented size of 2048-token-long context and 175 billion parameters (requiring 800 GB of storage). The training method is "generative pretraining", meaning that it is trained to predict what the next token is. The model demonstrated strong few-shot learning on many text-based tasks.
example_title: Wikipedia, text: Wikipedia is a free online encyclopedia that provides information to millions of people around the world. It is an open source website, meaning that anyone can edit and contribute articles to the encyclopedia. The website is maintained by a huge network of volunteers who are dedicated to making sure that the information is accurate and up to date. Wikipedia is an invaluable resource for people looking for reliable and accurate information on any topic.
Wikipedia is one of the most popular websites in the world, and its articles are often referenced in academic papers and other sources. The website is constantly being updated, and it is estimated that more than 500 million people visit it every month. It is an excellent source for basic information and for more in-depth research. It is important to remember though, that Wikipedia is not an academic source and should be used with caution when doing more serious research.
example_title: GPT-3
datasets: freddiezhang/autotrain-data-honor
co2_eq_emissions: emissions: 14.46129742532204
Likes: 0 | All-time downloads: 10
Created: 2022-12-19 05:04:04