close

DEV Community

#localllama

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Your local RAG isn't slow — it re-reads every document on every question
dreamdeck profile

Your local RAG isn't slow — it re-reads every document on every question

#rag #llm #performance #localllama
Comments
9 min read
LLMs on Consumer Hardware — Part 4: The Coordinator Search — Role-Casting and the Memory Wall
sven_welack profile

LLMs on Consumer Hardware — Part 4: The Coordinator Search — Role-Casting and the Memory Wall

#localllama #ai #llm #agents
Comments
4 min read
LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks
sven_welack profile

LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks

#localllama #ai #llm #homelab
Comments
3 min read
LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC
sven_welack profile

LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC

#localllama #ai #llm #homelab
Comments 3
4 min read
LLMs on Consumer Hardware — Part 3: A Multi-Agent Setup with Hermes — Delegation and Early Failure Modes
sven_welack profile

LLMs on Consumer Hardware — Part 3: A Multi-Agent Setup with Hermes — Delegation and Early Failure Modes

#localllama #ai #llm #agents
Comments
5 min read
What Actually Runs Well on a GTX 1080 Ti in 2026 (Measured)
sysoft profile

What Actually Runs Well on a GTX 1080 Ti in 2026 (Measured)

#llm #machinelearning #gemma #localllama
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.