close

DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Cheap OpenAI-compatible inference for AI agents via x402 ($0.10/1M tokens on Solana + Base)

Cheap OpenAI-compatible inference for AI agents via x402 ($0.10/1M tokens on Solana + Base)

Comments
3 min read
Model Cascade: making LLM classification cheaper

Model Cascade: making LLM classification cheaper

Comments
5 min read
Why this blog exists

Why this blog exists

Comments
2 min read
The Model Was Fine. My Token Assumptions Weren't.

The Model Was Fine. My Token Assumptions Weren't.

Comments
5 min read
How a Dedup Pass Deleted My Training Curriculum

How a Dedup Pass Deleted My Training Curriculum

Comments
6 min read
Your Free Token Allowance Is a Random Variable

Your Free Token Allowance Is a Random Variable

Comments
3 min read
Your Free Token Allowance Is a Ledger: Metering, Attribution, and Burn-Rate Forecasting

Your Free Token Allowance Is a Ledger: Metering, Attribution, and Burn-Rate Forecasting

Comments
5 min read
Build a Token-Budgeted LLM Service on a Free Server: A Step-by-Step Tutorial

Build a Token-Budgeted LLM Service on a Free Server: A Step-by-Step Tutorial

Comments
5 min read
从 Demo 到生产:那些真正让 AI Agent 敢上线的护栏

从 Demo 到生产:那些真正让 AI Agent 敢上线的护栏

Comments
2 min read
The Semantic Cache That Made a Free LLM Quota Feel Infinite

The Semantic Cache That Made a Free LLM Quota Feel Infinite

Comments
8 min read
MCP stdio Protocol's 3 Hidden Traps: When All Unit Tests Pass but the MCP Server Won't Respond

MCP stdio Protocol's 3 Hidden Traps: When All Unit Tests Pass but the MCP Server Won't Respond

Comments
13 min read
Garry Tan Was Right: "MCP Sucks Honestly." I Have the Token Receipts.

Garry Tan Was Right: "MCP Sucks Honestly." I Have the Token Receipts.

Comments
4 min read
The Retrieval Checklist I Wish I'd Had Before Shipping RAG

Shows why 73% of RAG failures happen upstream

The Retrieval Checklist I Wish I'd Had Before Shipping RAG

28
Comments 25
11 min read
Microsoft archived PyRIT (Mar 2026) - what LLM red-teamers should use instead

Microsoft archived PyRIT (Mar 2026) - what LLM red-teamers should use instead

Comments
2 min read
LLM Pricing This Week: DeepSeek Quietly Drops a Vision Model

LLM Pricing This Week: DeepSeek Quietly Drops a Vision Model

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.