Model: anishareddyalla/bge-base-matryoshka-aws-casestudies
Author: anishareddyalla
Pipeline: sentence-similarity
Library: sentence-transformers
Tags: sentence-transformers, safetensors, bert, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:2231, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss, en, arxiv:1908.10084, arxiv:2205.13147, arxiv:1705.00652, base_model:BAAI/bge-base-en-v1.5, base_model:finetune:BAAI/bge-base-en-v1.5, license:apache-2.0, model-index, text-embeddings-inference, endpoints_compatible, region:us
Base models (finetune): id: BAAI/bge-base-en-v1.5
Card metadata: base_model: BAAI/bge-base-en-v1.5
language: en
library_name: sentence-transformers
license: apache-2.0
metrics: cosine_accuracy@1, cosine_accuracy@3, cosine_accuracy@5, cosine_accuracy@10, cosine_precision@1, cosine_precision@3, cosine_precision@5, cosine_precision@10, cosine_recall@1, cosine_recall@3, cosine_recall@5, cosine_recall@10, cosine_ndcg@10, cosine_mrr@10, cosine_map@100
pipeline_tag: sentence-similarity
tags: sentence-transformers, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:2231, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss
widget: source_sentence: The fact that no customer noticed this major migration to Amazon S3 Glacier Instant Retrieval was a big win for us. It was a seamless experience for end users, and we had no production issues during the entire migration. ” Contact Sales Greater than 99. 99% Outcome | Gaining Insights on AWS to Prioritize Business Needs 한국어 Snap migrated more than 2 exabytes of data—roughly equivalent to 1. 5 trillion media files—seamlessly to Amazon S3 Glacier Instant Retrieval from Amazon S3 Standard-IA. “The fact that no customer noticed this major migration to Amazon S3 Glacier Instant Retrieval was a big win for us,” says Manoharan. “It was a seamless experience for Snapchatters, and we had no production issues during the entire migration. ” As a result of the migration, the company saved tens of millions of dollars on storage. Snap has configured Amazon S3 in 20 AWS Regions around the world so that customers anywhere can retrieve data in milliseconds. The AWS Global Infrastructure is the most secure, extensive, and reliable Global Cloud Infrastructure for a business’s applications. The global reach of AWS lets Snap store media closer to the place where Snapchatters are creating it for optimal performance. Snap is also able to deliver content efficiently using Amazon CloudFront, a content delivery network service built for high performance, security, and availability. “We’ve been able to off-load all of the regionalization work and costs to AWS so that we can focus on developing new features,” says Manoharan. As a result, Snapchat continues to meet its quarterly cost-optimization goals. Overview | Opportunity | Solution | Outcome | AWS Services Used 2 exabytes Amazon Simple Storage Service (Amazon S3) is an object storage service offering industry-leading scalability, data availability, security, and performance. … In 2016, Snap migrated its data to AWS. “We chose to migrate to AWS because of its global reach, excellent performance, and competitive pricing that, in turn, gave us the ability to reinvest in our business,” says Vijay Manoharan, manager of the media delivery platform team at Snap. Amazon S3 Glacier Instant Retrieval is an archive storage class that delivers the lowest-cost storage for long-lived data that is rarely accessed and requires retrieval in milliseconds. AWS Services Used In 2017, Snap migrated one of the app’s most central features—Snapchat Stories—to Amazon DynamoDB, a fully managed, serverless, NoSQL database designed to run high-performance applications at virtually any scale. Using Amazon DynamoDB, the company experienced greater than 99.
sentences: How did Snap save tens of millions of dollars on storage as a result of migrating to Amazon S3 Glacier Instant Retrieval from Amazon S3 Standard-IA?, How has Panasonic Avionics Corporation leveraged Amazon Aurora MySQL-Compatible Edition and other AWS services to improve the reliability and scalability of its databases for in-flight entertainment and communications systems?, How does Ground Truth Plus ensure the quality of image and video captions generated by human annotators?, source_sentence: ” 中文 (繁體) Bahasa Indonesia Contact Sales Ρусский Customer Stories / Software & Internet عربي 中文 (简体) Organizations of all sizes across all industries are transforming their businesses and delivering on their missions every day using AWS. Contact our experts and start your own AWS journey today. Outcome | Expanding Intelligent Features of Virtual Care Amazon Transcribe is an automatic speech recognition service that makes it easy to add speech to text capabilities to any application. Learn more » Learn more » It is critical that video visits are secure, responsive, and reliable. Using AWS helps us provide all this in a performant and scalable way. " Overview With the Amazon Chime SDK, builders can easily add real-time voice, video, and messaging powered by machine learning into their applications. Get Started Beyond traditional use cases, Salesforce is adding capabilities in medication-therapy management, connectivity for care coordinators, and other approaches for patient engagement. The company is developing a new feature that will expand its support of Virtual Care sessions to multiple participants, instead of just clinician and patient. This will facilitate care-team coordination with multiple parties in a single meeting. Using AWS, Salesforce circumvented the heavy lifting that would have been required to build and maintain a video-calling solution from scratch. Patients self-schedule virtual appointments, coordinate previsit activities, and conduct virtual visits in a HIPAA-compliant environment. A patient’s appointment request gets routed to Amazon Chime SDK. Clinicians then review a patient’s intake form and correlate the patient to a Virtual Care session using Amazon Chime SDK messaging, which connects providers and patients with secure, scalable messaging in their web and mobile applications. The Amazon Chime SDK control plane sends event notifications through a default event bus to Amazon EventBridge, a serverless event bus that helps organizations receive, filter, transform, route, and deliver events. Healthcare professionals deliver care over the internet in near real time, which has significantly reduced no-shows for appointments. “Using Amazon Chime SDK, we don’t have to worry about the mechanics of the video call,” Daftari says. “We can focus on features and functions that help differentiate our product in the marketplace, while also significantly improving our speed to launch. ” Salesforce further supports accessibility through embedding closed-captioning of video calls using Amazon Chime SDK live transcription. Amazon Chime SDK sends live audio streams to Amazon Transcribe, which automatically converts speech to text. Salesforce Health Cloud customers can use the live transcription capability to display subtitles, create meeting transcripts, or analyze content.
sentences: How did DB Energie use Amazon SageMaker and AWS to enhance the sustainability and reliability of its power grid operations?, How did Provectus assist Earth.com in enhancing the AI-powered image recognition capabilities of EarthSnap and reducing engineering heavy lifting through the implementation of end-to-end ML pipelines and managed MLOps platform?, How does Salesforce use AWS services such as Amazon Chime SDK and Amazon Transcribe to enhance their Virtual Care sessions for healthcare professionals and patients?, source_sentence: It’s been a great success. ” Overview 93% Validate technical skills and cloud expertise to grow your career and business. Learn more » Amazon Web Services (AWS) Education Programs collaborate with education institutions and the public sector to provide access for individuals to develop cloud computing and digital skills. To help graduates boost their employability, Staffordshire University worked with the AWS team to introduce cloud computing skills training and add cloud courses to its credit-bearing computer science modules. Staffordshire University offers courses through AWS Academy, which empowers higher education institutions to prepare students for industry-recognized certifications and careers. Since the university added AWS Academy courses to its curriculum in 2017, several hundred students have participated. Of those students, 93 percent have achieved employment within 6 months of graduation. Empowered students Türkçe Solution | Learning by Doing Using AWS Learner Labs English With AWS Academy, our students love that they’re not just taking theory lessons. They get to work in actual environments with real AWS tools. ” Next up, Staffordshire University is expanding on the success of its cloud courses by launching additional programs of study developed in collaboration with the AWS team. Staffordshire University and the AWS team designed these programs by "Working Backwards" — an Amazon process that encourages companies to brainstorm solutions by using a customer challenge as the starting point — from the cloud skills employers are currently seeking in the United Kingdom and across the global labor market. One of these programs, which launches in September 2022, is a cloud computing course that features both cloud computing and cybersecurity modules and will offer students more opportunities to discover what’s possible with the AWS Cloud. “What we want to encourage is for students to play with AWS services as well as build confidence with the tools,” says Dr. Champion. to learn remotely using any hardware and earn AWS Certifications Staffordshire University added cloud computing skills training to its curriculum using AWS Education Programs, helping 93 percent of participants find employment within 6 months of graduation. covering cloud skills AWS Certification during the AWS Educate University Challenge Deutsch of graduates find jobs within 6 months Tiếng Việt Italiano ไทย Outcome | Developing New Cloud Coursework About Staffordshire University Staffordshire University is a public research university in Staffordshire, England. Founded in 1914, the university serves over 15,000 students across three schools and four campuses. The United Kingdom has experienced a technology boom in recent years, with technology funding tripling in the first 6 months of 2021 compared to the same period in 2020. In particular, employers need professionals with cloud computing skills ranging from cloud development to machine learning and data analytics. To meet demand, Staffordshire University offers students their choice of six AWS courses covering these key skills and more.
sentences: How has the collaboration between Staffordshire University and the AWS team impacted the employability of graduates in the field of cloud computing?, How can the confidence scores be used to verify the accuracy of sentiment assignments in the sentiment_results_final table, especially for any dubious sentiment assignments?, How did migrating to AWS help Travian Games improve the stability and reliability of their game servers, and what impact did this have on their players' experience?, source_sentence: Contact our experts and start your own AWS journey today. customer and agent experience 2022 Overview WaFd Bank Transforms Contact Centers Using Conversational AI on AWS Customer Stories / Financial Services WaFd uses a data lake on AWS to store and analyze data from phone and chatbot conversations. “We’re getting incredible data from AWS through the conversational logs,” says Hubbard. “That has given us insights into what our customers are asking for so that we can add more self-service functionality. ” The data also gives WaFd more insight into call volumes, so the call center can better manage staff schedules. Opportunity | Using Amazon Lex to Implement an AI-Powered Contact Center Solution Türkçe English WaFd is a US retail and commercial bank with over 200 branches in eight states. In 2019, WaFd founded subsidiary Pike Street Labs, a fintech startup, to drive client-facing digital innovation for the bank. “Banks need to meet customers’ digital expectations,” says Dustin Hubbard, chief technology officer at WaFd Bank and Pike Street Labs. “Every year, customers expect more innovation because that’s what they see from new entrants or in other markets. ” Pike Street Labs redesigned WaFd’s online banking solution to provide personalized customer experiences and began tackling the bank’s customer care center. The company’s previous contact center solution used dated technology with limited features spread across disparate systems. This led to long wait times for customers and frustration for agents, who had to answer incoming calls without prior knowledge of what the customer needed. Agents also bore the burden of identifying fraudulent calls. WaFd needed a solution to improve both the customer and agent experiences. Previously, WaFd used two different systems in its customer care center to manage its voice and chat-based customer interactions, with no way for one system to recognize that an agent was busy on the other. Chat messages remained unanswered because agents would forget to sign in to the chat system. The company implemented chatbots and voice bots powered by Amazon Lex. Now, the call and chat systems are interoperable, and chats can be escalated to agent assisted calls when needed. When a call gets passed to an agent, the system also passes the full chat record and an analysis of the customer’s tone so that the agent is prepared to address the client’s needs and be empathetic toward the caller’s sentiment. WaFd worked with the AWS and Talkdesk teams to create and launch its new contact center solution in July 2022.
sentences: How did Yellow Class optimize its video files and improve performance using AWS services such as AWS Elemental MediaConvert?, How has FanDuel ensured the redundancy and reliability of its live video streams through the use of AWS Elemental MediaConnect and AWS Elemental MediaLive?, How did WaFd Bank use data from phone and chatbot conversations stored in a data lake on AWS to improve self-service functionality and better manage call center staff schedules?, source_sentence: Alternatively, you can run the inference via code. Here is one example written in Python, using the requests library: import requests url = "https://<YOUR_API_GATEWAY_ENDPOINT_ID>. execute-api. <YOUR_ENDPOINT_REGION>. amazonaws. com/prod/question?question=\"What is the color of my car now?\"&context=\"My car used to be blue but I painted red\"" response = requests. request("GET", url, headers=headers, data=payload) print(response. text) The code outputs a string similar to the following: '{"score":0. 6947233080863953,"start":38,"end":41,"answer":"red"}' If you are interested in knowing more about deploying Generative AI and large language models on AWS, check out here: Deploy Serverless Generative AI on AWS Lambda with OpenLLaMa Deploy large language models on AWS Inferentia2 using large model inference containers Clean up Inside the root directory of your repository, run the following code to clean up your resources: make destroy Conclusion In this post, we introduced how you can use Lambda to deploy your trained ML model using your preferred web application framework, such as FastAPI. We provided a detailed code repository that you can deploy, and you retain the flexibility of switching to whichever trained model artifacts you process. The performance can depend on how you implement and deploy the model. You are welcome to try it out yourself, and we’re excited to hear your feedback! About the Authors Tingyi Li is an Enterprise Solutions Architect from AWS based out in Stockholm, Sweden supporting the Nordics customers. She enjoys helping customers with the architecture, design, and development of cloud-optimized infrastructure solutions. She is specialized in AI and Machine Learning and is interested in empowering customers with intelligence in their AI/ML applications. In her spare time, she is also a part-time illustrator who writes novels and plays the piano. Demir Catovic is a Machine Learning Engineer from AWS based in Zurich, Switzerland. He engages with customers and helps them implement scalable and fully-functional ML applications. He is passionate about building and productionizing machine learning applications for customers and is always keen to explore around new trends and cutting-edge technologies in the AI/ML world. TAGS: Generative AI , Natural Language Processing Comments View Comments Resources Getting Started What's New Blog Topics Amazon Comprehend Amazon Kendra Amazon Lex Amazon Polly Amazon Rekognition Amazon SageMaker Amazon Textract Follow Twitter Facebook LinkedIn Twitch Email Updates.
sentences: How did ALTBalaji use AWS Elemental MediaLive to handle a tenfold increase in viewership during the live streaming of Lock Upp, and what insights did they gain from this experience?, How has PayEye been able to accelerate their development process and enter the production phase within a few months using AWS services, and what impact has this had on their recruitment efforts and team focus?, How can Lambda be used to deploy trained ML models using a preferred web application framework?
model-index: name: BGE base Financial Matryoshka
results: task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 768
type: dim_768
metrics: type: cosine_accuracy@1
value: 0.5120967741935484
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.8266129032258065
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.9233870967741935
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.9637096774193549
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5120967741935484
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.2755376344086021
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.18467741935483872
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.09637096774193549
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.5120967741935484
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.8266129032258065
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.9233870967741935
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.9637096774193549
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7538879073840729
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6844038018433181
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6858592666542238
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 512
type: dim_512
metrics: type: cosine_accuracy@1
value: 0.532258064516129
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.8225806451612904
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.9193548387096774
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.967741935483871
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.532258064516129
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.27419354838709675
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.18387096774193548
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.09677419354838711
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.532258064516129
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.8225806451612904
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.9193548387096774
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.967741935483871
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7596718979684643
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6912602406554021
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6924236134719179
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 256
type: dim_256
metrics: type: cosine_accuracy@1
value: 0.5241935483870968
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.8225806451612904
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.9193548387096774
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.9596774193548387
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5241935483870968
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.27419354838709675
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.1838709677419355
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.0959677419354839
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.5241935483870968
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.8225806451612904
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.9193548387096774
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.9596774193548387
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7527772429981233
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6846406169994881
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6862769216923534
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 128
type: dim_128
metrics: type: cosine_accuracy@1
value: 0.4959677419354839
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.7903225806451613
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.8911290322580645
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.9556451612903226
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.4959677419354839
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.26344086021505375
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.17822580645161293
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.09556451612903227
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.4959677419354839
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.7903225806451613
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.8911290322580645
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.9556451612903226
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.73375586078758
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6613495263696876
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6630698645438532
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 64
type: dim_64
metrics: type: cosine_accuracy@1
value: 0.4475806451612903
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.7661290322580645
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.8790322580645161
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.9475806451612904
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.4475806451612903
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.2553763440860215
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.17580645161290326
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.09475806451612903
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.4475806451612903
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.7661290322580645
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.8790322580645161
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.9475806451612904
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7052651530890945
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6260768689196109
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6277483838406475
name: Cosine Map@100
verified: no
Likes: 0 | All-time downloads: 5
Created: 2024-07-18 18:34:06