Yes, LangChain can function for information retrieval from documents without OpenAI. However, its question answering capabilities require LLM integration (OpenAI in this case). You can explore using open-source models from Hugging Face or alternatives like ollama, Mistral and Gemma.