Blog
Writing about engineering.
Token Based Turn Counts in Agents
Since agentic features can be expensive, the number of API calls must be intentionally managed. It is common to simply set a turn count and move on, but for complex agent workflows, static turn counts can meaningfully reduce the quality of the product. Token based turn counts could provide an alternative solution for high-turn-count agents that need stay within budget.
5 min read
The Evolving World of AI Memory
An overview of the current methods used to manage a language model's memory. There are several dynamic ways to manage an LLMs context window. Some are simple and easy to integrate with, others are subjective, others are meant to make the Language Model feel more human-like.
15 min read