What Is ChatGPT: How It Work And It's Limitations?
Tags: chatgpt, ai
Published: 2023-01-25 16:13:18

Introduction
OpenAI unveiled ChatGPT, a long-form question-answering AI that successfully answers difficult inquiries. It is a revolutionary piece of technology because it can be trained to comprehend what users mean when they ask questions.

Many users are astounded by its capacity for human-quality responses, which has led them to speculate that it may one day be able to transform how people interact with computers and how information is found. It comes with a ChatGPT conversational interaction model.

ChatGPT can answer follow-up questions, confess to errors, disprove unproven hypotheses, and decline inappropriate requests. InstructGPT, a sibling model of ChatGPT, which is trained to follow a prompt's instruction and provide a thorough response.

ChatGPT was developed by San Francisco-based artificial intelligence company OpenAI, a nonprofit organization. OpenAI is renowned for its well-known DALLE deep learning model, which creates images from text prompts. Sam Altman, who formerly served as the president of Y Combinator, is the CEO. Microsoft has invested $1 billion as a partner and investor. They worked together to create the Azure AI Platform.

What is ChatGPT?
ChatGPT is a chatbot launched by OpenAI in November 2022. It is built on top of OpenAI's GPT-3 family of large language models and is fine-tuned with both supervised and reinforcement learning techniques.

How does ChatGPT work?
ChatGPT has a remarkable ability to interact in conversational dialogue form and provide responses that can appear surprisingly human. It performs the task of predicting the next word in a series of words. Reinforcement Learning with Human Feedback (RLHF) is an additional layer of training that uses human feedback to help ChatGPT learn to follow directions and generate responses that are satisfactory to humans.

How was ChatGPT trained?
chatgpt diagram

In order to help ChatGPT learn dialogue and develop a human-like style of responding, GPT-3.5 was trained on enormous amounts of code-related data and information from the internet, including sources like Reddit discussions. In order for ChatGPT to understand what people expect when they ask a question, reinforcement learning with human feedback was also used during training. This new method of training the LLM goes beyond simply teaching it to predict the next word, making it revolutionary.

Training language models to follow instructions with human feedback

What are the limitations of ChatGPT?


An important limitation of ChatGPT is that the quality of the output depends on the quality of the input. In other words, expert directions (prompts) generate better answers.

ChatGPT is specifically programmed not to provide toxic or harmful responses. So it will avoid answering those kinds of questions.

Another limitation is that because it is trained to provide answers that feel right to humans, the answers can trick humans that the output is correct.

Many users discovered that ChatGPT can provide incorrect answers, including some that are wildly incorrect.

OpenAI explains ChatGPT's limitations as follows:

"

ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers. Fixing this issue is challenging, as: (1) during RL training, there’s currently no source of truth; (2) training the model to be more cautious causes it to decline questions that it can answer correctly; and (3) supervised training misleads the model because the ideal answer depends on what the model knows, rather than what the human demonstrator knows.
ChatGPT is sensitive to tweaks to the input phrasing or attempting the same prompt multiple times. For example, given one phrasing of a question, the model can claim to not know the answer, but given a slight rephrase, can answer correctly.
The model is often excessively verbose and overuses certain phrases, such as restating that it’s a language model trained by OpenAI. These issues arise from biases in the training data (trainers prefer longer answers that look more comprehensive) and well-known over-optimization issues.12
Ideally, the model would ask clarifying questions when the user provided an ambiguous query. Instead, our current models usually guess what the user intended.
While we’ve made efforts to make the model refuse inappropriate requests, it will sometimes respond to harmful instructions or exhibit biased behavior. We’re using the Moderation API to warn or block certain types of unsafe content, but we expect it to have some false negatives and positives for now. We’re eager to collect user feedback to aid our ongoing work to improve this system.
"

How to use ChatGPT


The ChatGPT webpage is simple and includes an area for the results to populate and a text box at the bottom of the page for users to type inquiries.

You also have the option of more specifically inputting requests for an essay with a specific number of paragraphs or a Wikipedia page. If there is enough information available, the generator will fulfill the commands with accurate details. Otherwise, there is potential for ChatGPT to begin filling in gaps with incorrect data. You also have the option to use ChatGPT in dark mode or light mode.

Do you need to download ChatGPT?
ChatGPT is available via a webpage, so no downloading is needed. OpenAI has yet to release an official app, despite the fact that app stores are full of fake versions. These should be installed and used with caution, as they are not official ChatGPT apps.

You can, apparently, download ChatGPT locally through Github, though it’s not necessary to use it.
visit https://www.centdam.com.ng/ for more...