close

DEV Community

Jasur Yuldoshev profile picture

Jasur Yuldoshev

404 bio not found

Joined Joined on  github website
Your local RAG isn't slow — it re-reads every document on every question

Your local RAG isn't slow — it re-reads every document on every question

Comments
9 min read
"V cache quantization requires flash_attn" — the llama.cpp error that quietly halves your context window

"V cache quantization requires flash_attn" — the llama.cpp error that quietly halves your context window

Comments
10 min read
Streaming returned 0 tokens and llama_decode died: asyncio.wait_for was killing my generator

Streaming returned 0 tokens and llama_decode died: asyncio.wait_for was killing my generator

Comments
4 min read
Hot-swapping GGUF models kernel-panicked my M4 Mac: wired memory, llama.cpp, and why we restart the server instead

Hot-swapping GGUF models kernel-panicked my M4 Mac: wired memory, llama.cpp, and why we restart the server instead

Comments
5 min read
Your Hugging Face download isn't stuck — you're being rate-limited

Your Hugging Face download isn't stuck — you're being rate-limited

Comments
5 min read
My local RAG silently returned nothing: a missing Ollama daemon, and moving embeddings in-process with llama.cpp

My local RAG silently returned nothing: a missing Ollama daemon, and moving embeddings in-process with llama.cpp

Comments 1
4 min read
loading...