Cool Announcements @ AWS ReInvent CEO KeyNote
Tags: aws, reinvent
Published: 2023-11-29 08:01:31


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/p1qed37aszkp4t0afk8w.jpg)

**S3 Express One Zone**
Highest performance lowest latency cloud storage
50% less cost than S3 standard 
10 times faster than S3 standard
Single-digit millisecond latency
Millions of requests per second
Co-locate storage and compute in the same AZ 
Pinterest has 10x faster write-speed and 40% less cost from S3 Express One Zone

**Graviton 4**
30% faster than Graviton3
Faster and more energy-efficient
R8g Ec2 instance with Graviton4 in preview

**EC2 Ultra-clusters**
20,000 GPUs, connected by EFA of 32000 GBPS 
Equal to a supercomputer = 20 Exaflops

New GPU = GH200 which is 4 times faster with new LLM compilers
Uses Grace Hopper technology to connect CPU and GPU at 1TBPS
32 GH200 can connect via the NVLINK switch.

**NVIDIA DGX cloud is coming to AWS**
This is NVIDIA's AI Factory, connecting 16,000+ GPUs together. 
65 Exaflops compute capacity and will make LLM learning 2x fast 

**EC2 Capacity Blocks for ML **
Reserve EC2 Ultra Clusters for short-term usage

**Trainium 2**
4x faster, second-gen specially designed chips for training models

**ML Customization in AWS**

Fine-tuning available in:
Titan Text Lite, Express, Cohere Command Lite, Meta Llama 2, and Anthropic Claude

Retrieval-Augmented Generation with Knowledge Bases 
(Announced Sept 2023)

Continued Pre-Training is available in AWS Bedrock. The technique involves using large amounts of unlabeled data before fine-tuning a model,

**Agents for Bedrock **
Execute multi-step actions across company systems powered by ML

**Guardrails for Bedrock**
Safeguard generative AI applications with responsible AI policies

**Education Commitment**
AWS commits to training 29 million people in the cloud and 2 million in AI for free by 2025. 

**AWS CodeWhisperer Customization Capability **
Provide custom code suggestions using internal SDK, api, and code. 

**Amazon Q (Some of the features in Preview)**
This is the new service I am most excited for. 
AI assistant designed for the business world that understands your company information. 
Can chat with Q in AWS console, documentation, code whisperer, and chat apps like Slack.
Q is already trained with all the AWS information, WAF principles, etc.
Troubleshoot errors with Q when you get an error in the AWS console. 
Get recommendations and step-by-step information
Feature Development: Develop a new feature in AWS using Q using prompts interactively and iteratively
Code Transformation: Use Q to upgrade language versions in code eg: 1000 Java apps upgraded in 2 days
Business expert: Connect to over 40 data sources and answer business questions, supports RBAC
Amazon Q inside Quicksight: Create BI reports and visualizations using generative AI by Q
Amazon Q inside Amazon Connect: AI Agent stays on-call, to help on-call agents with customer interaction

**Zero-ETL integrations with Redshift in:**
Aurora Postgres, RDS for MySQL, DynamoDB
As soon as data is written into these databases, query and analyze in Redshift without ETL pipeline.

**Zero-ETL integration between DynamoDB and OpenSearch**
Search DyanmoDB data through Opensearch without doing ETL.

**AI recommendations for Amazon DataZone**
Add business descriptions to data in DataZone using AI. 

Project Kuiper
A constellation of low Earth orbit satellites that aims to provide fast, affordable, and reliable broadband to customers in areas without reliable internet connection. Private network connectivity is now available.