Kaboo
An open-source token-analysis project inside ByteDance, built without hand-offs: I raised the problem, designed the Token Efficiency Leaderboard, tested it and shipped it myself.
- Company
ByteDance
- Project
- Kaboo, internal open source
- My part
- Token Efficiency Leaderboard
- Reach
- 10,000+ internal users
What it is
Kaboo is an open-source project inside ByteDance that analyzes token consumption.
The most interesting thing about it, though, isn't what it does but how it was made: with a new way of working together.
How we work
There's no relay of people here, no "file a requirement, schedule it, build it, test it, ship it." Whoever raises a problem designs the fix, runs the tests and deploys it to production themselves. Each person owns their part, end to end.
Quality rests on two safeguards:
- Before release, an agent checks the change for problems.
- After release, anything that goes wrong can be rolled back quickly.
Why it works
It works because the infrastructure is in place. We build on mew, a project-management platform that builds agents into the software-development process, and it is connected to Lark.
The road from idea to implementation is already paved. As long as you can say clearly what you want, you can build it and ship it yourself.
What I did
Working this way, I owned the Token Efficiency Leaderboard and the efficiency-analysis module.
I raised the problem. Everyone looked at where agents failed; nobody looked at tasks that succeeded but were wasteful along the way.
I designed the fix:
- I defined criteria for five kinds of waste.
- I designed a diagnosis that uses only metadata and never touches content.
- I normalized cost across different models with Effective Tokens.
Then I tested it and shipped it myself. It now covers more than 10,000 internal users.
What I learned
This gave me a very concrete picture of how collaboration works in the AI era. Once the infrastructure flattens the cost of implementation, the bottleneck becomes whether you can think a problem through and say it clearly.
A person's value lies more in judgment than in execution.
Board
Drag to move · ⌘ / Ctrl + scroll or pinch to zoom · full screen for a closer look
Outcome
- 10K+
- Internal users the leaderboard and the analysis now cover
- 5
- Kinds of waste, each with a criterion for spotting it
- Metadata only
- The diagnosis never reads the content of a session