How to Run Your Own Local LLMs: Updated for Early 2025

16 Tools to Run Your Local LLMs

First published on https://hackernoon.com/you-can-run-these-16-llms-locally-no-questions-asked

If you are not yet a Medium member, you can read the story at this link below:

https://thomascherickal.medium.com

With Privacy Support

Doing this article has become a yearly favorite, so I plan to add extra value by doing two editions this year.

All of the tools below are free, many are open-source, and there are a wide range of LLMs, SLMs, and LMMs out there.

For the uninitiated:

1. LLMs — Large Language Models that work only with text.
2. SLMs — Small Language Models that typically have less than 10B parameters.
3. LMMs — Large Multi-modal Models that work with text, images, audio, and video.

Use perplexity.ai to learn new terms.

I prefer Perplexity over Google for practically everything these days.

I might do a follow-up article about the best models to use with these tools.

There are 16 tools to run and interact with your local LLMs, all given below.