πŸ–₯️a local llm starter kit for a normal laptop

no cloud subscription, no api key. just stuff that actually runs on your own machine

01
Ollama
one command in terminal and you're running a model. this is where i tell everyone to start
02
LM Studio
03
Open WebUI
chatgpt-style interface on top of ollama. makes local models feel normal day to day
04
llama.cpp
05
Jan
06
Hugging Face
where the model files live. look for GGUF if you're on cpu
07
8b models are the sweet spot on 16gb of ram
08
canceled my chatgpt plus sub after two weeks running this
still pay for claude for actual work though

Or start a list of your own. Free, it takes a minute.