Unleashing AI Power Locally: Using LM Studio
Tags: ai, llm, huggingface
Published: 2023-11-25 12:39:32

### Introduction

In my experience dealing in developing AI powered applications using [langchain] framework, I arrived to need to involve a local LLM model. So I started searching for some guides or videos and at the end I landed on video: "[Run ANY Open-Source Model LOCALLY][video1]". Seeing this very interesting video, I have realized that in the fast-paced realm of AI, open-source large language models have become increasingly accessible, particularly thanks to the [🤗 Hugging Face] portal and I discovered existence of [LM Studio] a freely downloadable tool designed to simplify the deployment and run of open-source large language models on local machines. Below I summarise the main features offered by [LM Studio] which enable users to quickly explore and test the “open-source LLM”’s world

### LM Studio features

[LM Studio]'s user-friendly interface and cross-platform availability make it an attractive choice for a wide range of users. Key features and usage guidelines include:

1\. **Platform Compatibility:** [LM Studio] is available for Apple, Windows, and Linux systems, ensuring wide accessibility.

2\. **Ease of Installation:** The installation process is straightforward, making the software accessible even to those with limited technical background.

3\. **Model Exploration and Selection:** Users can browse and select from a variety of models available on the Hugging Face platform. [LM Studio] provides detailed information for each model, aiding in informed decision-making.
<figure>
  <img src="https://dev-to-uploads.s3.amazonaws.com/uploads/articles/h0j08niag6jo87f3p13e.png" alt=""><figcaption>search model 🔍</figcaption>
</figure>
----

4\. **Model Management:** The software allows for efficient management of different model versions, including quantized versions, tailored to the user's system specifications.
<figure>
  <img src="https://dev-to-uploads.s3.amazonaws.com/uploads/articles/kat1z3ihlinz28u5np1g.png" alt=""><figcaption>manage model 👀</figcaption>
</figure>
----

5\. **Interactive Chat Interface:** An integral feature of [LM Studio] is its chat interface, which allows users to interact with the models. This interface includes adjustable settings for various model parameters, enhancing user control.<figure>
  <img src="https://dev-to-uploads.s3.amazonaws.com/uploads/articles/o2dyyi743adje40f6oul.png" alt=""><figcaption>chat with model 💬📋</figcaption>
</figure>
----

6\. **Developer Tools:** For developers looking to integrate large language models into their applications, [LM Studio] offers a local server feature. This feature **is compatible with [OpenAI's API][openai-api]** 🤩, facilitating easy integration.
<figure>
  <img src="https://dev-to-uploads.s3.amazonaws.com/uploads/articles/gr0a6r3cv8z0lk3mps8x.png" alt=""><figcaption>start server 🚀</figcaption>
</figure>
----

7\. **Efficient Storage Management:** Users can manage the models on their system efficiently, adding or removing them as needed to manage storage space effectively.
<figure>
  <img src="https://dev-to-uploads.s3.amazonaws.com/uploads/articles/zwi2mg0o81zpf94eqmoh.png" alt=""><figcaption>file management 🗂️</figcaption>
</figure>
----

### Conclusion

[LM Studio] emerges as a powerful and user-friendly tool for anyone interested in exploring and utilizing large language models. It is suitable for both personal experimentation and professional application development. [LM Studio] democratises access to AI technology, enabling users to leverage the power of large language models on their local machines.

I'm already using it and it works great. I highly recommend checking it out to have a better understanding of the LLM models ecosystem, which isn't limited only to GPT 3/4. 🤨

Let me know your experience on its usage 💬👋

***

_Originally published at https://bsorrentino.github.io on November 25, 2023_.


[🤗 Hugging Face]: https://huggingface.co
[LM Studio]: https://lmstudio.ai
[video1]: https://www.youtube.com/watch?v=yBI1nPep72Q
[langchain]: https://www.langchain.com
[openai-api]: https://openai.com/blog/openai-api