Yes, EleutherAI GPT-Neo is designed to extend the benefits of large language models to cultures and contexts beyond English. The Polyglot Project, a part of EleutherAI's research, focuses on training LLMs in languages other than English and Chinese, facilitating cross-cultural communication and understanding.