How to Run Your Own Local LLM: Updated for 2024 — Version 1

Originally published at https://hackernoon.com on March 21st, 2024

This is the breakout year for Generative AI!

Well; to say the very least, this year, I’ve been spoiled for choice as to how to run an LLM Model locally.

Let’s start!

1) HuggingFace Transformers:

Magic of Bing Image Creator — Very imaginative.

All Images Created by Bing Image Creator

To run Hugging Face Transformers offline without internet access, follow these steps:

Running HuggingFace Transformers Offline in Python on Windows

Requirements:

• Python 3.6+
• PyTorch (version compatible with Transformers)
• Transformers library Tokenizers library
• Sentence Transformers library (optional, for sentence-level tasks)

Steps:

1. Download the model: