Being Data-Driven is a Mindset Shift
Tags: aws, machinelearning, awss3, datadriven
Published: 2023-04-14 18:52:37

## Data-driven organizations are paving the way to more efficient, resilient and performance-rich futures. 
 This article will explore a deeper look into the **what**, **why** and **how** AWS is driving innovation with AI/ML and what that means for scaling data-driven organizations.


**How to decipher this piece:** _This piece will be in a Q&A format to maintain clarity in breaking down what, why and how._
1. Browse categorized WHAT, WHY & HOW questions
2. Scroll down to Q&A 
3. Glean insights from AWS specialists
4. Take a look at how globally known companies leveraging AI/ML with AWS
5. Learn what focus zones data-driven organizations should consider to scale long term  

- **WHAT?** What does it mean to be a data-driven organization? What is Amazon’s flywheel model? What is AI vs ML? What are the key drivers for a data network effect? What precautions should be in place to prevent disruptions in data architecture? What services unlock CX (Customer Experience) improvements?

- **WHY?** Why should we consider data as a cornerstone for building people-centered technology? Why is a mindset shift key to fueling the flywheel at Amazon? Why is building a centralized data community crucial for improving data governance?

- **HOW?** How is AI/ML driving speed and efficiency in data-driven organizations today? How are consumers and producers impacted? How is ML being used in real time & which companies are using AWS?

**What does it mean to be a data-driven organization?**
- It is the recognition that data is an asset to create actionable insights to supercharge the customer experience. Adopting the data-driven mindset is an opportunity to influence each stakeholder’s narrative.

**What is Amazon’s flywheel model?**
- Let's take a look at Amazon's flywheel elements:

(Mindset + People + Process) x Technology

The concept is to keep the people, technology and the process at the center of all decision-making and using products, customer experience, feedback and data as learning models to experiment with to create innovation. Data-driven organizations recognize that it’s a process of working backwards from experience to create technology.

![(Mindset + People + Process) x Technology](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/usfwmtvdvzl1xrmz8bc0.png)

**Why should we consider data as a cornerstone for building people-centered technology?**

- Putting data at the center of decision-making enables organizations to: 
➡ Make decisions, faster
➡ Respond better to the unexpected
➡ Create better customer experiences
➡ Uncover new opportunities
➡ Improve efficiency

**Why is building a centralized data community crucial for improving data governance?**

- It’s connected to how each sector of the community (producers, platform teams, consumers) extracts its business value.

➡ Producers: data sharing within teams to produce insights and KPIs, metadata and access considerations to retain owner governance

➡ Platform team: increases scalability and managing data compliance to move at the speed of business priorities

➡ Consumers: creators of new insights, data discoverers

**Why is a mindset shift key to fueling the flywheel at Amazon?**

- Mental models exist to drive and inform. Changing the mindset is key to fueling the flywheel because it involves placing value in who, what and why organizations create for and extracting insights from data directly is how the elements of the flywheel are enhanced.

**How is AI/ML driving speed and efficiency in data-driven organizations today?**

- Machine Learning requires a rich set of capabilities and data is the field for ML engines. As Tom Godden (AWS Enterprise Strategist) highlighted, 

> "When coupled with other implementations, AI has the power to change biz models…alone it cannot.”

- 3 key drivers for ML adoption: Relevance | Speed | Efficiency

**What is AI vs ML?**
- AI = Artificial Intelligence: involves the using computer science to learn from data models as humans learn from experiences.

- ML = Machine Learning: a subset of AI that involves using algorithms to learn and make predictions based on data.

- There are 3 main types of ML:

1. Supervised learning
classification: predicts a category
example: classifying a sock by color
regression model: investigates the relationship between variables

2. Unsupervised learning
clustering: groups by similarity
example: sorting clothes by type
association: clothes often worn together

3. Reinforcement learning
environment based: do not need specific input/output pairs
example: reacts to and learns from environment


![What is machine learning?](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/rmhvsimfmvs05b9j84qu.png)

**What are the key drivers for a data network effect?**
- ML is a tool to support business activations through customer needs to improve the CX. The cycle of The Data Network Effect thrives on 4 key drivers:

1. More data
2. Better algorithms
3. Better engagement
4. More, happier customers

**How are consumers and producers impacted?**

- By adopting the modern data-driven mindset, consumers can focus on engaging with products and producers can efficiently manage data retrieved from their experiences. This creates a culture of enhancing data discovery through increased visibility and trustworthiness, simplifying collaboration, working seamlessly with tools in context.

**What services can unlock CX (Customer Experience) improvements (a non-exhaustive list)?**
- [Amazon Kendra (search)](https://aws.amazon.com/kendra/)
- [Amazon Lex (chatbot)](https://aws.amazon.com/lex/)
- [QuickSight (business intelligence dashboards)](https://aws.amazon.com/quicksight/)
- [AWS S3 (simple object storage)](https://aws.amazon.com/s3/)
- [Amazon EBS (elastic block storage)](https://aws.amazon.com/ebs/)
- [Amazon Connect (cloud contact center)](https://aws.amazon.com/connect/)
- [Amazon Transcribe (speech to text](https://aws.amazon.com/transcribe/)
- [Amazon Textract (extracts data from any document)](https://aws.amazon.com/textract/)  

**What precautions should be in place to prevent disruptions in data architecture?**

- To prevent disruptions, building resilient data structures that can manage the durability and performance of workloads. So how is this achieved? Through working with storage services like Amazon S3 and Amazon EBS.

Factors to consider for resilient structures: 

➡ Resiliency: needs to match the workload that can manage the durability and performance of a workload

➡ Backups: back up volumes by taking point-in-time snapshots and storing them in S3

➡ Build your own redundancy: consider alternate routes for recovery, like Elastic Disaster Recovery

➡ Design for availability: no single point of failure should bring the system down (consider a load balancer)

➡ Monitoring, Testing & Recovery: simulate real-world conditions, create experiments to test

**How is ML being used in real time & which companies are using AWS?**

- [The Washington Post](https://aws.amazon.com/solutions/case-studies/washington-post-arc/) - Textract, ECS, Docker, EC2
- [NASCAR](https://aws.amazon.com/blogs/storage/modernizing-nascars-multi-pb-media-archive-at-speed-with-aws-storage/) - Transcribe, S3 Glacier Instant Retrieval, SQS
- [Condé Nast](https://aws.amazon.com/solutions/case-studies/conde-nast-russia/?did=cr_card&trk=cr_card) - Route 53, EC2, S3
- [Fender](https://aws.amazon.com/solutions/case-studies/fender/?did=cr_card&trk=cr_card) - Lambda, DynamoDB, API Gateway, SageMaker
- [Lyft](https://aws.amazon.com/partners/success/lyft-anodot/?did=cr_card&trk=cr_card) - AWS Kinesis Streams, Auto Scaling, Redshift, EC2 Container Registry
- [F1](https://aws.amazon.com/sports/f1/) - Lambda, SageMaker, DynamoDB API Gateway
- [United Airlines](https://aws.amazon.com/solutions/case-studies/united-airlines-reinvent-video/?did=cr_card&trk=cr_card) - SageMaker, IoT Care
- [Expedia](https://aws.amazon.com/solutions/case-studies/innovators/expedia/?did=cr_card&trk=cr_card) - Aurora, Glue, CloudWatch
- [Pinterest](https://aws.amazon.com/blogs/industries/aws-is-how-pinterest-lens-helps-pinners-find-and-buy-the-perfect-item/?did=cr_card&trk=cr_card) - S3
- [BMW Group](https://aws.amazon.com/solutions/case-studies/bmw-group-case-study/) - Translate, Active Custom Translate, AWS Glue, AppSync
- [Traeger](https://aws.amazon.com/partners/success/traeger-grills-ost/) - IoT Core, Alexa Voice Service, Lambda, S3
- [Heineken](https://aws.amazon.com/solutions/case-studies/heineken-customer-story/?did=cr_card&trk=cr_card) - IoT GreenGrass

> Data exists to be computed and stored, fed by efficient stage that can manage the data.
 Ryan Sayre

It’s an exciting time to learn and engage with AI, and with the release of several machine learning services like [OpenAI](https://openai.com/) and search engines such as [You.com](https://you.com/), the globe is being taken by an AI-powered storm. As Godden highlighted in his AWS Innovate session 'Building a Smarter Organization: Powered by ML',

> "When coupled with other implementations, AI has the power to change business models...alone it cannot."

AWS is paving the way to a more cohesive, resilient and performance-rich future, and the companies listed above are living proof of the power cloud computing has created. The more producers, platform teams and consumers engage as data-driven communities, the better the experience can improve for all.

➡ Think Big ➡ Work Backwards ➡ Design & Build