close

DEV Community

#aiengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
LangChain vs Bedrock: Which AI Framework to Choose?

LangChain vs Bedrock: Which AI Framework to Choose?

Comments
19 min read
I Kept Hitting GPU Out-of-Memory Errors at 100K Tokens: Here’s What Was Actually Eating the Memory

I Kept Hitting GPU Out-of-Memory Errors at 100K Tokens: Here’s What Was Actually Eating the Memory

Comments
9 min read
TurboVec: How to Use Google's TurboQuant for Faster Vector Search in Rust

TurboVec: How to Use Google's TurboQuant for Faster Vector Search in Rust

Comments
4 min read
The Margin, Not the Price

The Margin, Not the Price

Comments
4 min read
AI is writing more of our code every day. But are we paying close attention to what happens when that code quietly fails?

AI is writing more of our code every day. But are we paying close attention to what happens when that code quietly fails?

Comments
1 min read
WebGPU LLM Inference: Running 7B Models Natively in the Browser

WebGPU LLM Inference: Running 7B Models Natively in the Browser

Comments
4 min read
Structured Output Generation: Enforcing JSON & Regex at the Logits Level

Structured Output Generation: Enforcing JSON & Regex at the Logits Level

Comments
3 min read
OmniRouter Architecture: Resilient LLM Gateway Routing & Fallback Pipelines

OmniRouter Architecture: Resilient LLM Gateway Routing & Fallback Pipelines

Comments
5 min read
ColBERT Late Interaction: Advancing RAG Beyond Dense Embeddings

ColBERT Late Interaction: Advancing RAG Beyond Dense Embeddings

Comments
4 min read
Serving Mixture of Experts (MoE): Memory-Efficient Inference Routing

Serving Mixture of Experts (MoE): Memory-Efficient Inference Routing

Comments
3 min read
S-LoRA: Multiplexing Thousands of Fine-Tuned Adapters on a Single GPU

S-LoRA: Multiplexing Thousands of Fine-Tuned Adapters on a Single GPU

Comments
3 min read
KV Cache INT4 Quantization for 1M+ Token Context Windows

KV Cache INT4 Quantization for 1M+ Token Context Windows

Comments
3 min read
Multi-Agent Swarm Orchestration: Hierarchical Agentic Workflows

Multi-Agent Swarm Orchestration: Hierarchical Agentic Workflows

Comments
3 min read
DSPy: Replacing Prompt Engineering with Declarative Optimization Compilers

DSPy: Replacing Prompt Engineering with Declarative Optimization Compilers

Comments
3 min read
How to Build Your Own Custom AI Assistant Like Gemini: The Ultimate Step-by-Step Guide

How to Build Your Own Custom AI Assistant Like Gemini: The Ultimate Step-by-Step Guide

Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.