Show HN: Distill and serve small models with frontier quality for half the cost Hi HN, we built world-model-optimizer, an open-source tool for continually improve models specialized to agents. Today
By Coderz Club · 2026-07-27 · Tags: ai, go
Show HN: Distill and serve small models with frontier quality for half the cost
Hi HN, we built world-model-optimizer, an open-source tool for continually improve models specialized to agents. Today we are launching `wmo serve`, a tool to route repetitive tasks to distilled smaller models.Agent traces you already capture are opportunities to get signal on how to make your model cheaper, faster, better. We continuously improve - your specialized model through distillation from open source models - model routing to frontier + custom models - token compaction to remove noise and save tokensDemo: https://www.youtube.com/watch?v=2_m4Ze6mdkoPass in traces and an OpenRouter key, and wmo starts a local OpenAI-compatible endpoint to run with your model at a lower cost with equivalent quality. Behind the scenes a router decides which tasks should go to the frontier versus your model. Tinker continually trains as new traces arrive.We also offer a hosted solution for anyone that just wants a frontier quality endpoint with self-improvement over time at a 40%+ lower cost.Sign up for the waitlist at https://experientiallabs.ai! Comments URL: https://news.ycombinator.com/item?id=49063454 Points: 36 # Comments: 7
Hi HN, we built world-model-optimizer, an open-source tool for continually improve models specialized to agents. Today we are launching `wmo serve`, a tool to route repetitive tasks to distilled smaller models.Agent traces you already capture are opportunities to get signal on how to make your model cheaper, faster, better. We continuously improve - your specialized model through distillation from open source models - model routing to frontier + custom models - token compaction to remove noise and save tokensDemo: https://www.youtube.com/watch?v=2_m4Ze6mdkoPass in traces and an OpenRouter key, and wmo starts a local OpenAI-compatible endpoint to run with your model at a lower cost with equivalent quality. Behind the scenes a router decides which tasks should go to the frontier versus your model. Tinker continually trains as new traces arrive.We also offer a hosted solution for anyone that just wants a frontier quality endpoint with self-improvement over time at a 40%+ lower cost.Sign up for the waitlist at https://experientiallabs.ai! Comments URL: https://news.ycombinator.com/item?id=49063454 Points: 36 # Comments: 7