My ORA workflow: Why I deleted my "68% savings" claim
go install github.com/vystartasv/ora/cmd/ora@latestora "build a login system with JWT"
ora "refactor the API to use async handlers and add tests"
ora "design the database schema for a multi-tenant SaaS" --plan
I recently deleted the most impressive-looking part of the README. It used to claim that running a task through ORA was 68% cheaper than sending everything to a flagship model. It looked great, but it was a "worked example" masquerading as a measurement.
The trap of counterfactual metrics
The problem is that a flagship model doesn't just cost more per token—it does more work per token. A cheap model might burn 2,000 tokens, fail, and retry twice. A flagship might spend 400 tokens and get it right the first time.
If your "savings" metric is just comparing "didn't use the expensive one" against "used the expensive one," you aren't benchmarking. You're looking in a mirror. Any metric that requires imagining a run that never actually happened is a story, not a measurement.
Shifting to real-world observability
Instead of chasing imaginary percentages, I refactored the core logic. I stripped the "savings" calculation out of orchestrate.go and the report structs. Now, the tool focuses on what actually matters for production: actual run cost.
Every subtask's real token usage is pulled directly from the API, multiplied by the real per-model price, and printed.
5 subtasks · 4 models · $0.0038No counterfactuals. No "what if" scenarios. Just the truth of what you spent. If you are trying to decide whether to adopt an LLM agent workflow, you need to know your real burn rate, not a theoretical discount.
How the ORA agent works
For anyone looking for a practical tutorial on how this decomposition works, the logic follows a specific pipeline:
When you are building complex AI workflows, don't get distracted by "X% faster" claims. Stick to the actual tokens and actual latency. That is the only way to build something maintainable.