Claude 2.1 AI model with 200K Context is Live
Tags: llm, openai, anthropic, ai
Published: 2023-11-22 06:50:15

...and available as both a UI chatbot and API.

Yesterday **Claude 2** model received an update doubling its context window size to 200K. [Here's the official intro](https://www.anthropic.com/index/claude-2-1) by Anthropic. This happened 12 days after [Open AI introduced](https://dev.to/maximsaplin/whats-new-in-openai-announcements-at-nov2023-devday-1k7c) **GPT-4 Turbo** which was upgraded from 32K to 128K context.

## Is it a lot?

Following up on my [recent post](https://dev.to/maximsaplin/gpt-4-128k-context-it-is-not-big-enough-1h02) translating context window size from tokens to different kinds of artefacts. Here's an updated table:

| Artefact                                                             | Tokens   | \# in 200k |
| -------------------------------------------------------------------- | -------- | ---------- |
| Tweet                                                                | 76       | 2,632      |
| Book page (Robinson Crusoe)                                          | 282      | 709        |
| Google Results Page (copy/paste, txt)                                | 975      | 205        |
| StackOverflow Question (copy/paste, txt)                             | 947      | 211        |
| [](http://apple.com/)[apple.com](http://apple.com/)(copy/paste, txt) | 997      | 201        |
| StackOverflow Question (Markdown)                                    | 1037     | 193        |
| Blog post (Markdown)                                                 | 4572     | 44         |
| Linux Kernel average source file                                     | 5205     | 38         |
| SCRUM Guide (2020)                                                   | 5440     | 37         |
| Wikipedia page (Albania, copy/paste, txt)                            | 42492    | 4.7        |
| Wikipedia page (Albania, source, wikitext)                           | 76462    | 2.6        |
| [](http://apple.com/)[apple.com](http://apple.com/)(source, HTML)    | 92091    | 2.2        |
| “The Lean Startup” book                                              | 113264   | 1.8        |
| 128K Context                                                         | 128000   | 1.6        |
| PM BoK (4th edition, 2008)                                           | 228880   | 0.87       |
| Google Results Page (source, HTML)                                   | 246781   | 0.81       |
| Linux Kernel largest source file                                     | 69039016 | 0.0029     |

## Context Size timeline

Here's a quick rundown of model release dates and context windows:

- [November 21, 2023](https://www.anthropic.com/index/claude-2-1) : Claude 2.1 - **200K**
- [November 6, 2023](https://openai.com/blog/new-models-and-developer-products-announced-at-devday) :  GPT-4 Turbo - **128K**
- [June 12, 2023](https://openai.com/blog/function-calling-and-other-api-updates) : `gpt-3.5-turbo-0613` - **16K**
- [May 11, 2023](https://www.anthropic.com/index/100k-context-windows) : Claude100K - **100K**
- [March 14, 2023](https://openai.com/research/gpt-4) : GPT4 - **8K** and **32K**
- [March 14, 2023](https://www.anthropic.com/index/introducing-claude) : Claude - **9K**
- [November 30, 2022](https://openai.com/blog/chatgpt) : ChatGPT/GPT3.5 - **4K**
- [June 11, 2020](https://openai.com/blog/openai-api) : GPT3 - **2K**


## P.S.:

On a side matter. I'm fascinated by how little progress in internet search has been made. Both Bing AI and Google Bard produce complete nonsense should your request require more than a few top results to produce a meaningful result :)

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/vtydtfyqeqfhrm93y4dx.png)