Tuesday, June 13, 2023

OpenAI - Models Overview + GPT 3 vs 4 Comparisons & Setups

+ GPT 3 vs 4 Comparisons & Setups



Chat GPT 4 vs ChatGPT-3 Comparison:
12 Examples - ChatGPT Plus


Free ChatGPT vs ChatGPT Plus With Plugins


Technical - For Programmers Only
ChatGPT 4 Vs 3.5 (ChatGPT 4 Compared To 3.5)



* * * * * * *


OpenAI - Models Overview


The OpenAI API is powered by a diverse set of models with different capabilities and price points. You can also make limited customizations to our original base models for your specific use case with fine-tuning.

MODELSDESCRIPTION
GPT-4 
Limited beta
A set of models that improve on GPT-3.5 and can understand as well as generate natural language or code
GPT-3.5A set of models that improve on GPT-3 and can understand as well as generate natural language or code
DALL·E
Beta
A model that can generate and edit images given a natural language prompt
Whisper
Beta
A model that can convert audio into text
EmbeddingsA set of models that can convert text into a numerical form
ModerationA fine-tuned model that can detect whether text may be sensitive or unsafe
GPT-3A set of models that can understand and generate natural language
DeprecatedA full list of models that have been deprecated

We have also published open source models including Point-EWhisperJukebox, and CLIP.

Visit our model index for researchers to learn more about which models have been featured in our research papers and the differences between model series like InstructGPT and GPT-3.5.


With the release of gpt-3.5-turbo, some of our models are now being continually updated. We also offer static model versions that developers can continue using for at least three months after an updated model has been introduced. With the new cadence of model updates, we are also giving people the ability to contribute evals to help us improve the model for different use cases. If you are interested, check out the OpenAI Evals repository.

The following models are the temporary snapshots, we will announce their deprecation dates once updated versions are available. If you want to use the latest model version, use the standard model names like gpt-4 or gpt-3.5-turbo.

MODEL NAMEDISCONTINUATION DATEREPLACEMENT MODEL
gpt-3.5-turbo-030109/13/2023gpt-3.5-turbo-0613
gpt-4-031409/13/2023gpt-4-0613
gpt-4-32k-031409/13/2023gpt-4-32k-0613

Learn more about model deprecation on our deprecation page.

GPT-4 is currently in a limited beta and only accessible to those who have been granted access. Please join the waitlist to get access.

GPT-4 is a large multimodal model (accepting text inputs and emitting text outputs today, with image inputs coming in the future) that can solve difficult problems with greater accuracy than any of our previous models, thanks to its broader general knowledge and advanced reasoning capabilities. Like gpt-3.5-turbo, GPT-4 is optimized for chat but works well for traditional completions tasks both using the Chat Completions API. Learn how to use GPT-4 in our GPT guide.

On June 27th, 2023, gpt-4 will be updated to point from gpt-4-0314 to gpt-4-0613, the latest model iteration.
LATEST MODELDESCRIPTIONMAX TOKENSTRAINING DATA
gpt-4More capable than any GPT-3.5 model, able to do more complex tasks, and optimized for chat. Will be updated with our latest model iteration 2 weeks after it is released.8,192 tokensUp to Sep 2021
gpt-4-0613Snapshot of gpt-4 from June 13th 2023 with function calling data. Unlike gpt-4, this model will not receive updates, and will be deprecated 3 months after a new version is released.8,192 tokensUp to Sep 2021
gpt-4-32kSame capabilities as the base gpt-4 mode but with 4x the context length. Will be updated with our latest model iteration.32,768 tokensUp to Sep 2021
gpt-4-32k-0613Snapshot of gpt-4-32 from June 13th 2023. Unlike gpt-4-32k, this model will not receive updates, and will be deprecated 3 months after a new version is released.32,768 tokensUp to Sep 2021

For many basic tasks, the difference between GPT-4 and GPT-3.5 models is not significant. However, in more complex reasoning situations, GPT-4 is much more capable than any of our previous models.

GPT-3.5 models can understand and generate natural language or code. Our most capable and cost effective model in the GPT-3.5 family is gpt-3.5-turbo which has been optimized for chat but works well for traditional completions tasks as well.

On June 27th, 2023, gpt-3.5-turbo will be updated to point from gpt-3.5-turbo-0301 to gpt-3.5-turbo-0613.
LATEST MODELDESCRIPTIONMAX TOKENSTRAINING DATA
gpt-3.5-turboMost capable GPT-3.5 model and optimized for chat at 1/10th the cost of text-davinci-003. Will be updated with our latest model iteration 2 weeks after it is released.4,096 tokensUp to Sep 2021
gpt-3.5-turbo-16kSame capabilities as the standard gpt-3.5-turbo model but with 4 times the context.16,384 tokensUp to Sep 2021
gpt-3.5-turbo-0613Snapshot of gpt-3.5-turbo from June 13th 2023 with function calling data. Unlike gpt-3.5-turbo, this model will not receive updates, and will be deprecated 3 months after a new version is released.4,096 tokensUp to Sep 2021
gpt-3.5-turbo-16k-0613Snapshot of gpt-3.5-turbo-16k from June 13th 2023. Unlike gpt-3.5-turbo-16k, this model will not receive updates, and will be deprecated 3 months after a new version is released.16,384 tokensUp to Sep 2021
text-davinci-003Can do any language task with better quality, longer output, and consistent instruction-following than the curie, babbage, or ada models. Also supports some additional features such as inserting text.4,097 tokensUp to Jun 2021
text-davinci-002Similar capabilities to text-davinci-003 but trained with supervised fine-tuning instead of reinforcement learning4,097 tokensUp to Jun 2021
code-davinci-002Optimized for code-completion tasks8,001 tokensUp to Jun 2021

We recommend using gpt-3.5-turbo over the other GPT-3.5 models because of its lower cost and improved performance.

OpenAI models are non-deterministic, meaning that identical inputs can yield different outputs. Setting temperature to 0 will make the outputs mostly deterministic, but a small amount of variability may remain.

DALL·E is a AI system that can create realistic images and art from a description in natural language. We currently support the ability, given a prommpt, to create a new image with a certain size, edit an existing image, or create variations of a user provided image.

The current DALL·E model available through our API is the 2nd iteration of DALL·E with more realistic, accurate, and 4x greater resolution images than the original model. You can try it through the our Labs interface or via the API.

Whisper is a general-purpose speech recognition model. It is trained on a large dataset of diverse audio and is also a multi-task model that can perform multilingual speech recognition as well as speech translation and language identification. The Whisper v2-large model is currently available through our API with the whisper-1 model name.

Currently, there is no difference between the open source version of Whisper and the version available through our API. However, through our API, we offer an optimized inference process which makes running Whisper through our API much faster than doing it through other means. For more technical details on Whisper, you can read the paper.

Embeddings are a numerical representation of text that can be used to measure the relateness between two pieces of text. Our second generation embedding model, text-embedding-ada-002 is a designed to replace the previous 16 first-generation embedding models at a fraction of the cost. Embeddings are useful for search, clustering, recommendations, anomaly detection, and classification tasks. You can read more about our latest embedding model in the announcement blog post.


The Moderation models are designed to check whether content complies with OpenAI's usage policies. The models provide classification capabilities that look for content in the following categories: hate, hate/threatening, self-harm, sexual, sexual/minors, violence, and violence/graphic. You can find out more in our moderation guide.

Moderation models take in an arbitrary sized input that is automatically broken up to fix the models specific context window.

MODELDESCRIPTION
text-moderation-latestMost capable moderation model. Accuracy will be slighlty higher than the stable model
text-moderation-stableAlmost as capable as the latest model, but slightly older.

GPT-3 models can understand and generate natural language. These models were superceded by the more powerful GPT-3.5 generation models. However, the original GPT-3 base models (davincicurieada, and babbage) are current the only models that are available to fine-tune.

LATEST MODELDESCRIPTIONMAX TOKENSTRAINING DATA
text-curie-001Very capable, faster and lower cost than Davinci.2,049 tokensUp to Oct 2019
text-babbage-001Capable of straightforward tasks, very fast, and lower cost.2,049 tokensUp to Oct 2019
text-ada-001Capable of very simple tasks, usually the fastest model in the GPT-3 series, and lowest cost.2,049 tokensUp to Oct 2019
davinciMost capable GPT-3 model. Can do any task the other models can do, often with higher quality.2,049 tokensUp to Oct 2019
curieVery capable, but faster and lower cost than Davinci.2,049 tokensUp to Oct 2019
babbageCapable of straightforward tasks, very fast, and lower cost.2,049 tokensUp to Oct 2019
adaCapable of very simple tasks, usually the fastest model in the GPT-3 series, and lowest cost.2,049 tokensUp to Oct 2019

Your data is your data.

As of March 1, 2023, data sent to the OpenAI API will not be used to train or improve OpenAI models (unless you explitly opt in). One advantage to opting in is that the models may get better at your use case over time.

To help identify abuse, API data may be retained for up to 30 days, after which it will be deleted (unless otherwise required by law). For trusted customers with sensitive applications, zero data retention may be available. With zero data retention, request and response bodies are not persisted to any logging mechanism and exist only in memory in order to serve the request.

Note that this data policy does not apply to OpenAI's non-API consumer services like ChatGPT or DALL·E Labs.

ENDPOINTDATA USED FOR TRAININGDEFAULT RETENTIONELIGIBLE FOR ZERO RETENTION
/v1/completionsNo30 daysYes
/v1/chat/completionsNo30 daysYes
/v1/editsNo30 daysYes
/v1/images/generationsNo30 daysNo
/v1/images/editsNo30 daysNo
/v1/images/variationsNo30 daysNo
/v1/embeddingsNo30 daysYes
/v1/audio/transcriptionsNoZero data retention-
/v1/audio/translationsNoZero data retention-
/v1/filesNoUntil deleted by customerNo
/v1/fine-tunesNoUntil deleted by customerNo
/v1/moderationsNoZero data retention-

For details, see our API data usage policies. To learn more about zero retention, get in touch with our sales team.

ENDPOINTMODEL NAME
/v1/chat/completionsgpt-4, gpt-4-0613, gpt-4-32k, gpt-4-32k-0613, gpt-3.5-turbo, gpt-3.5-turbo-0613, gpt-3.5-turbo-16k, gpt-3.5-turbo-16k-0613
/v1/completionstext-davinci-003, text-davinci-002, text-curie-001, text-babbage-001, text-ada-001
/v1/editstext-davinci-edit-001, code-davinci-edit-001
/v1/audio/transcriptionswhisper-1
/v1/audio/translationswhisper-1
/v1/fine-tunesdavinci, curie, babbage, ada
/v1/embeddingstext-embedding-ada-002, text-search-ada-doc-001
/v1/moderationstext-moderation-stable, text-moderation-latest

This list does not include our first-generation embedding models nor our DALL·E models.

No comments:

Post a Comment