Summarize this and list important information as bullet points: Skip to content

Advertisement
Menu

SearchSearch
Search...
Published on May 22, 2023
In News
Meta’s Breakthrough Language Model on Par with GPT-4 and Bard in Performance
One of the notable aspects of LIMA’s performance is its ability to generalise well to unseen tasks that were not part of its training data.
By Mohit Pandey
 
 
 
 



Listen to this story
Researchers for Meta AI, alongside Carnegie Mellon University, University of Southern California and Tel Aviv University, today unveiled LIMA, a 65 billion parameter LLaMa language model fine-tuned with the standard supervised loss on only 1,000 carefully curated prompts and responses, without any reinsurance learning or human preference modelling. 

Check out the research paper: LIMA: Less Is More for Alignment

Meta’s AI chief Yann LeCun said that this is on par with GPT-4 and Bard in terms of performance. 

The researchers said that LIMA has shown strong capabilities in learning specific response formats with minimal training examples. They said that it can effectively handle complex queries, ranging from planning travel itineraries to speculating about alternate history. 

Interestingly, one of the notable aspects of this new language model’s performance is its ability to generalise well to unseen tasks that were not part of its training data. In other words, LIMA can apply its learned knowledge to new and unfamiliar tasks, demonstrating a level of flexibility and adaptability, shared by the researchers. 

In comparison to human-controlled responses, specifically GPT-4, Bard, and DaVinci-003 (trained with human feedback), the responses generated by LIMA were quite impressive. For instance, in 43% of cases, responses from LIMA were either equivalent to or preferred over GPT-4. In the case of Bard, LIMA was preferred in 58% of cases. In the case of DaVinci-003, the preference rose to almost 65%.


It is interesting to note that with only limited instruction tuning data, models like LIMA can generate high-quality output. 

A few weeks back, Meta also released MEGABYTE, a scalable architecture for modelling long sequences. This new technique has outperformed existing byte-level models across a range of tasks and modalities, allowing large models of sequences of over 1 million tokens.

 
 
 
 
Download our Mobile App


Mohit Pandey
Mohit dives deep into the AI world to bring out information in simple, explainable, and sometimes funny words. He also holds a keen interest in photography, filmmaking, and the gaming industry.



Subscribe to our newsletter
Join our editors every weekday evening as they steer you through the most significant news of the day.
Email
Enter your email
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.
Our Upcoming Events
Deep Learning DevCon 2023
May 27, 2023 | Online
Register
Rakuten Product Conference 2023
31st May - 1st Jun '23 | Online
Register
MachineCon 2023 India
Jun 23, 2023 | Bangalore
Register
MachineCon 2023 USA
Jul 21, 2023 | New York
More Details
Cypher 2023
Oct 11-13, 2023 | Bangalore
Register
3 Ways to Join our Community
Telegram group
Discover special offers, top stories, upcoming events, and more.

JOIN TELEGRAM
Discord Server
Stay Connected with a larger ecosystem of data science and ML Professionals

JOIN DISCORD COMMUNITY
Subscribe to our Daily newsletter
Get our daily awesome stories & videos in your inbox
SUBSCRIBE
MOST POPULAR

Miserable Meta Banks on AI Ads with Sandbox
With nothing extraordinary to offer, is Meta’s AI Sandbox just another attempt to stay relevant in the AI race?


Why Amazon Prime Dumped Serverless for Monolithic Architecture
Microservices were better suited for startups which had mushroomed all over because startups would obviously have smaller tech teams


Council Post: Building Responsible Generative AI
The results of using generative AI, like any cognitive technologies, rely on how well the risks are managed, which have not received as much attention as their ability. 


8 Things That Bard Can Do, But ChatGPT Can’t
Google has added several new features to enhance user experience and overcome some limitations of ChatGPT. But will it be the jack of all trades and master of none?


The Pitfalls of Fear-Mongering in AI
Anthropomorphism has helped shift the responsibility from the humans behind the technologies to the technology itself


Amazon Throws Another Hat in the Gen AI Ring
After arriving late to the genAI party with Bedrock, the search giant seems to be hush-hush about its AI chatbot

When will Generative AI Make Investors Smile?
When will Generative AI Make Investors Smile?
The only thing that generative AI is not capable of currently is generating money


No, European Draft AI Act Does Not Target Open-Source Softwares 
The act have introduced a range of bans on what the European Parliament refers to as “intrusive and discriminatory uses of AI systems.”


Council Post: Towards An Ethical Tech Revolution: Building Responsible AI Practices
A responsible AI framework enables companies to track and mitigate bias and create transparent and explainable AI models, prevent misuse and adverse effects of AI, determine who to be held responsible if something goes wrong, and ensure compliance with security, privacy, and associated regulations.


Generative AI in Gaming is a Double-edged Sword
Twelve years after its release, The Elder Scrolls V: Skyrim is being reinvented with the help of generative AI

Our Mission Is To Bring About Better-Informed And More Conscious Decisions About Technology Through Authoritative, Influential, And Trustworthy Journalism.
SHAPE THE FUTURE OF TECH
CONTACT US ⟶

AIM discovers new ideas and breakthroughs that create new relationships, new industries, and new ways of thinking. AIM is the crucial source of knowledge and concepts that make sense of a reality that is always changing.

Our discussions shed light on how technology is transforming many facets of our life, from business to society to culture.
Facebook
Twitter
Youtube
Linkedin
Instagram
WHO WE ARE
ABOUT US
NEWSLETTERS
PODCAST
VIDEOS
EVENTS
CAREERS
EDITORIAL CALENDAR
CONTACT US
OUR BRANDS
MACHINEHACK
BEST FIRM CERTIFICATION
AIM RECRUITS
AIM RESEARCH
AIM LEADERS COUNCIL
ASSOCIATION OF DATA SCIENTISTS
PENETRATION AND MATURITY (PEMA) QUADRANT
OUR SERVICES
ADVERTISE WITH US
BESPOKE EVENTS
EMPLOYER BRANDING
HACKATHONS
RECRUITMENT SERVICES
SYNDICATED RESEARCH
ADVISORY
SKILL ASSESSMENT
OUR CONFERENCES
CYPHER
MACHINECON INDIA
MACHINECON USA
MACHINE LEARNING DEVELOPERS SUMMIT
THE RISING | WOMEN IN TECH CONFERENCE
DATA ENGINEERING SUMMIT
AWARDS
AI100 AWARDS
DATA SCIENCE EXCELLENCE AWARDS
40 UNDER 40 DATA SCIENTISTS
WOMEN IN TECH LEADERSHIP
BEST FIRM FOR WOMEN IN TECH
DATA ENGINEERING AWARDS
FOR DEVELOPERS
HACKATHONS
PRACTICE SKILLS
COURSES
DISCUSSION BOARD
JOB BOARD
TECHNICAL BLOGS
AIM CAMPUS AMBASSADOR
© ANALYTICS INDIA MAGAZINE PVT LTD & AIM MEDIA HOUSE LLC 2023

Terms of use
Privacy Policy
Copyright