I write about technology, gnu/linux, startups, cooking, hicking, blues and mooore !
Local OSS LLMs for Noobs like me
One of the many things I’d been procrastinating on was running a Large Language Model (LLM) locally. One weekend, I finally decided to do it. It was supposed to be simple, but my curiosity wouldn’t let me just follow a guide and move on. I wanted to actually understand the ecosystem and how everything works, without diving too deep into the math or internals. Here’s what I learned, from a complete beginner’s point of view: ...