AI & ML interests

L4NLP (Long-context for NLP applications) lab is part of the HKUNLP group. We focus on (1) developing new approaches that extend the context window of large language models while maintaining the reasoning ability of LLMs on the pertaining context length, (2) Instituting standardized evaluation methods for Long-context language models and (3) collecting long SFT data for training long-context models.