On Memorization of Large Language Models in Logical Reasoning
Paper
•
2410.23123
•
Published
•
18
Re-Align Project @ AI2
non-profit
AI & ML interests
We rethink and reimagine the alignment of LLMs.
Recent Activity
View all activity
re-align's activity
yuchenlin
authored
a
paper
about 2 months ago
yuchenlin
authored
5
papers
6 months ago
WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
Paper
•
2406.18495
•
Published
•
12
MantisScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation
Paper
•
2406.15252
•
Published
•
14
WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences
Paper
•
2406.11069
•
Published
•
13
Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
Paper
•
2406.08464
•
Published
•
65
WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
Paper
•
2406.04770
•
Published
•
27
Post
2380
Introducing **BaseChat**!
https://huggingface.co/spaces/allenai/BaseChat_URIAL
This is a demo for our URIAL paper that enables base LLMs to chat with in-context alignment. You can talk directly with base, untuned LLMs to find out what knowledge and skills they have already learned from pre-training instead of SFT or xPO or RLHF. Also, you can use this to explore the pre-training data of base LLMs by chatting! I found a very interesting case: Base version of Llama-3-8B often thinks it is built by OpenAI, lol.
https://huggingface.co/spaces/allenai/BaseChat_URIAL
This is a demo for our URIAL paper that enables base LLMs to chat with in-context alignment. You can talk directly with base, untuned LLMs to find out what knowledge and skills they have already learned from pre-training instead of SFT or xPO or RLHF. Also, you can use this to explore the pre-training data of base LLMs by chatting! I found a very interesting case: Base version of Llama-3-8B often thinks it is built by OpenAI, lol.
yuchenlin
authored
a
paper
8 months ago
yuchenlin
authored
a
paper
9 months ago
yuchenlin
authored
4
papers
10 months ago
Trial and Error: Exploration-Based Trajectory Optimization for LLM Agents
Paper
•
2403.02502
•
Published
•
3
SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
Paper
•
2402.08983
•
Published
•
2
OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement
Paper
•
2402.14658
•
Published
•
82
L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objects
Paper
•
2402.09052
•
Published
•
17
Post
Introducing Vision Arena (beta)! Based on the lmsys's ChatbotArena, we create a simple demo for testing different Vision LMs (VLMs). We now support GPT-4V, Gemini-Pro-Vision, and Llava. More updates and models will come soon! We are still in the development stage and for now and we'd love to hear your feedback and suggestions! Please help us vote for better VLMs in your own use cases here! :D Kudos to Yujie Lu (UCSB)!
WildVision/vision-arena
WildVision/vision-arena
- 3 replies
yuchenlin
updated
2
datasets
11 months ago
yuchenlin
updated
a
dataset
12 months ago
yuchenlin
updated
a
Space
12 months ago
yuchenlin
updated
2
datasets
12 months ago