close

DEV Community

#benchmarking

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I put my cost router on a neutral benchmark. It ranked near the bottom, and that's the interesting part
fortitudeomnis profile

I put my cost router on a neutral benchmark. It ranked near the bottom, and that's the interesting part

#llm #ai #opensource #benchmarking
Comments 2
5 min read
The Model Reading My Benchmark Mattered More Than the Memory System Did
spranab profile

The Model Reading My Benchmark Mattered More Than the Memory System Did

#ai #llm #benchmarking #opensource
Comments
7 min read
I benchmarked CognoDB against four other graph databases. The most interesting result had nothing to do with CognoDB.
sachin_meru profile

I benchmarked CognoDB against four other graph databases. The most interesting result had nothing to do with CognoDB.

#webdev #database #devops #benchmarking
Comments 1
5 min read
I benchmarked 5 graph databases. The first four hours measured the Indian Ocean.
burz4m_13b009bb9f0a92a88c profile

I benchmarked 5 graph databases. The first four hours measured the Indian Ocean.

#showdev #database #benchmarking #devops
Comments
6 min read
Last night we entered a memory benchmark against Tencent and Mem0. The score isn't back yet - and I'm publishing it either way.
bryanw profile

Last night we entered a memory benchmark against Tencent and Mem0. The score isn't back yet - and I'm publishing it either way.

#showdev #ai #buildinpublic #benchmarking
1
Comments
4 min read
Don't Trust a New Model's Benchmarks Until You Run Your Own 30-Minute Smoke Test
webx_2736 profile

Don't Trust a New Model's Benchmarks Until You Run Your Own 30-Minute Smoke Test

#ai #programming #benchmarking #opensource
Comments
5 min read
I tried to build a "token optimization stack" for coding agents. Here's why I killed it.

A 97% savings metric masked silent failures
shreyasht profile

I tried to build a "token optimization stack" for coding agents. Here's why I killed it.

#ai #llm #benchmarking #opensource
3
Comments 9
7 min read
Before You Adopt MiniMax H3, Run a Twenty-Minute Model Audit
aiio_6471 profile

Before You Adopt MiniMax H3, Run a Twenty-Minute Model Audit

#ai #opensource #programming #benchmarking
Comments
3 min read
DeepSeek Harness: What "Everything is a Plugin" Actually Means for Agent Frameworks
cole_halton_42f71d71b809b profile

DeepSeek Harness: What "Everything is a Plugin" Actually Means for Agent Frameworks

#deepseek #aiagents #opensource #benchmarking
Comments
2 min read
Free Model Endpoints Are an Evaluation Problem, Not a Hosting Strategy
techpy_768 profile

Free Model Endpoints Are an Evaluation Problem, Not a Hosting Strategy

#ai #opensource #benchmarking #python
Comments
3 min read
New Benchmark for Evaluating Long-Horizon Agents in Online Environments
dd8888 profile

New Benchmark for Evaluating Long-Horizon Agents in Online Environments

#ai #benchmarking #agents #onlineservices
Comments
4 min read
Native HTTP Engine for Node: Performance Benchmarks Against uWS, Bun, Fastify, and Hono
raiyanu profile

Native HTTP Engine for Node: Performance Benchmarks Against uWS, Bun, Fastify, and Hono

#node #performance #http #benchmarking
Comments
3 min read
Where to split a sentence for streaming TTS is decided by one number
renga154 profile

Where to split a sentence for streaming TTS is decided by one number

#performance #typescript #ai #benchmarking
Comments
5 min read
Measuring LLM Prefix Caching: The Cache Hit Rate Metric
wheynelau profile
Wayne

Measuring LLM Prefix Caching: The Cache Hit Rate Metric

#llm #benchmarking #performance
Comments
6 min read
llmperf Is Archived: Alternatives for LLM Benchmarking
wheynelau profile
Wayne

llmperf Is Archived: Alternatives for LLM Benchmarking

#rust #benchmarking #llm
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.