LM Studio

LM Studio is a free desktop application that provides an easy way to run open-source AI models locally on your device. To get started, simply visit the LM studio website and download the latest version for your Mac (M1/M2/M3 minimum) or Windows PC (a GPU with 6GB+ VRAM and 16GB+ RAM is recommended). Once installed, the dashboard allows you to browse and download compatible models hosted on Hugging Face like LLaMA, Falcon, and more. LM Studio handles configuring and running the models, providing a chat interface for you to interact with them.