The Log Is The Agent - Ishaan Sehgal, Omnara

AI Engineer · 15 min · 176 sentences · from YouTube's caption track

Each timecode opens YouTube at the start of that sentence. Line anchors (#s42) are the cue ids in the WebVTT, and every line carries its start and end seconds. All transcripts has every talk, and the whole corpus as one file.

  1. 00:00Hey everyone, I'm Ishaan the CEO of Amnara and today I'm going to be talking about the log is the agent.
  2. 00:06The basic idea of the talk is simple and that is most people think of an agent as the model or the execution environment that it's running in and I think that that's the wrong abstraction.
  3. 00:16I think that the thing that actually gives an agent its identity is its log and that's what I'm going to be arguing today.
  4. 00:25So think about a character you've spent a hundred hours playing in your favorite video game, in this case Skyrim.
  5. 00:32What exactly is your character?
  6. 00:34Is it the game engine?
  7. 00:36Is it the PlayStation?
  8. 00:37Is it the controller?
  9. 00:39No, it's not.
  10. 00:41Those things matter and those things are what will interact with and they'll run the character but none of those things are your character.
  11. 00:48Your character is data.
  12. 00:49It's the save file.
  13. 00:52And this is important because if your PlayStation bursts into flames, your character isn't gone.
  14. 00:58You can buy another PlayStation, you can download your save file from the cloud and you can resume exactly where they were and that's because the agent and its identity and history and its state is all
  15. 01:11captured in its data.
  16. 01:13The character lives in the data and this is the framing that I want to bring to agents.
  17. 01:19Today when people talk about agents, they usually point at the wrong thing.
  18. 01:24They'll say that the agent is the model or they'll say that it's the runtime and again as I mentioned earlier, those things matter but they're not the agent.
  19. 01:32The agent is its data.
  20. 01:34It's specifically the log.
  21. 01:37So what actually is the log?
  22. 01:39At the simplest level, the log is the append-only event history of the agent.
  23. 01:44It's every user input, every model output, every tool called, tool result, permission, failure and the idea is that every state transition that the agent takes is written to the log.
  24. 01:58This is important because it means that the identity of the agent isn't tied to the runtime or the model or the tools.
  25. 02:06Those things are all just interpreting and appending to the log.
  26. 02:09They're reading the log, acting on it, and writing the next event back.
  27. 02:14And that's important because then just using the log on its own is enough to resume the agent.
  28. 02:22Once you define the agent as a log, the rest of the system becomes a whole lot easier to reason about because every operation is either reading from or appending
  29. 02:31to the log.
  30. 02:33The model is reading from the log and then determining the next action.
  31. 02:38The tool runner is then executing that action and then it's appending that result.
  32. 02:43And this is all operating in a loop.
  33. 02:46Everything coordinates itself around the log.
  34. 02:49In practice, a simplified loop can look something like this.
  35. 02:52You can reconstruct the state from the log.
  36. 02:54You can pass that state to the model.
  37. 02:56The model can propose the next step and then append that response to the log.
  38. 03:00If the response asks for a tool, you can run that tool and also append that response to the log and then you can repeat.
  39. 03:06The important insight is not that this loop is complicated.
  40. 03:10The important insight is that the loop is disposable.
  41. 03:13A worker can claim the session, read the log, advance the agent one step, write the result, and then just completely disappear.
  42. 03:19And then that means that any other worker can pick it up later.
  43. 03:24This pattern should feel familiar.
  44. 03:27Databases had to learn this first.
  45. 03:29For years, databases looked like these non-transparent systems that were hard to reason about with tables and indexes and materialized views, but underneath every serious database is a log.
  46. 03:41And that log is the durable sequence of changes.
  47. 03:47Everything else is a view.
  48. 03:49I I agents need the same inversion.
  49. 03:52Today, agents are treated as again, these complicated systems that are opaque and they're filled with models and prompts and tool calls, but for the durable session, the log should be primary.
  50. 04:04The context that gets fed into the model is a projection of that log.
  51. 04:08The UI that gets rendered on top is a projection of that log.
  52. 04:12Debugging and traceability is a projection.
  53. 04:15Auditing is a projection.
  54. 04:16Compaction is also projection, which we'll talk about.
  55. 04:20But the log itself is not a projection.
  56. 04:22The log is the durable history that all of these projections can come from.
  57. 04:27Now, there are two objections to the log as the agent that are worth discussing.
  58. 04:31So, I'm going to talk about them now.
  59. 04:32Now, let's start with compaction.
  60. 04:34A log can grow indefinitely, but a model's view of it can't.
  61. 04:39Context windows are finite.
  62. 04:41So, eventually, you do need to compact the log into a smaller representation that the model can reason about.
  63. 04:48But the important point is that this compaction is not magic and it doesn't break the claim that the log is the agent.
  64. 04:54Compaction is lossy.
  65. 04:57A compacted summary is not going to perfectly reproduce the state of the agent in a smaller form.
  66. 05:02It's actually going to throw information away.
  67. 05:05The point is the full log is the record and a compaction is just one projection of it.
  68. 05:10Just like how a materialized view is not the database or a summary of a conversation is not the conversation.
  69. 05:16If you keep the raw log, you can always generate new projections from it.
  70. 05:21But if you throw away the raw log and keep only the compaction, you've effectively lost part of the agent.
  71. 05:27So, it's cleanest to treat compaction as a best effort lossy fork, one that you can resume as a new log.
  72. 05:36The second objection is what about tools that change state outside of the log?
  73. 05:41And that's true.
  74. 05:42An agent can edit a file.
  75. 05:44It can create a GitHub issue.
  76. 05:45It can send an email.
  77. 05:46So, clearly, there is state outside of the log.
  78. 05:49But, the point is is that the log is not supposed to contain the whole world.
  79. 05:54The log is just the agent's view of the world.
  80. 05:56It's just like how in the video game in in Skyrim, the Skyrim save file doesn't contain the entire game engine or every asset in the map.
  81. 06:04It just contains the player specific state, which is needed to drop you back into that world.
  82. 06:09And the same is true for the log and agents.
  83. 06:13The log can only faithfully resume or store that agent's identity and its view of the world, but it cannot make that world deterministic.
  84. 06:21If the agent sent an email, forking back won't unsend it.
  85. 06:25If some file got changed underneath, the agent won't know about it.
  86. 06:30But, the log's job is to record what the agent did, what it saw, what changed, and what it needs to continue.
  87. 06:37It stores that identity, and that's its purpose.
  88. 06:40And much like that Skyrim character save file, it's not meant to store the entire world.
  89. 06:46It's just meant to store its view of it.
  90. 06:49So, once you start treating the log as a primitive, a whole bunch of system properties will fall out naturally.
  91. 06:55So, the first property is reliability.
  92. 06:58Consider what happens today with Cloud Code.
  93. 07:00If you're using Cloud Code and your agent reaches a permission prompt and the process dies for whatever reason, and then you resume it, the permission prompt will be gone,
  94. 07:11and the agent will be paused.
  95. 07:13And that is unacceptable in production.
  96. 07:16The permission prompt should stay there.
  97. 07:18So, this is just a sign of when you architect your agent in a way where the log isn't the agent.
  98. 07:26When the log is the agent, the executor is allowed to be fallible.
  99. 07:31A new worker will pick up the session.
  100. 07:33It'll reconstruct the state, and it'll see that the permission prompt is there right where it was.
  101. 07:38So, even though the process died, the agent didn't along with it.
  102. 07:43The second property is scalability.
  103. 07:46Most harnesses will run one process per agent, which means that the agent is tied to the machine running it.
  104. 07:52When the log is the state, you flip that model.
  105. 07:55One process can now advance thousands of agents.
  106. 07:58Each of them can reconstruct their state from the log on each turn, and they don't need to be tied to any single machine or worker.
  107. 08:06This makes failover trivial, and it also makes scaling just a matter of adding more workers.
  108. 08:12There's no sticky sessions, there's no state migration, and there's no coordination overhead.
  109. 08:17Forking becomes a whole lot more natural, too.
  110. 08:20Instead of having to force like one linear path, you can easily branch the log.
  111. 08:25One branch can run on Claude, another branch can run on GPT, another can run on your favorite open-source model.
  112. 08:31Each of the branches can store some of the history up until the fork point, and then they can explore different strategies.
  113. 08:39Multiplayer is another property.
  114. 08:41Sharing an agent with someone should not mean having to copy some transcript and paste it into Slack.
  115. 08:46If the log is the agent, sharing means you simply grant access to that history, so that somebody else can view it and edit it.
  116. 08:57A teammate can open the session, they can see what happened, a manager can observe without taking over, and even another agent could consume the same session as context.
  117. 09:09This is really important because it means that the value is not just what the agent produced, it's also the log, which indicates how it got there.
  118. 09:20Migration follows the same pattern.
  119. 09:22If an agent's identity is trapped in provider-specific threads and memories and formats and runtime assumptions, moving providers becomes really painful.
  120. 09:33But if the log is the agent, migration is just a adapter problem.
  121. 09:38Different models may want different projections of the log, and different runtimes may need different schemas, but those are all become just engineering problems.
  122. 09:49They're not identity problems.
  123. 09:51The agent should then be able to start on Claude, continue on GPT, and finish on Gwen without losing itself.
  124. 09:58The log serves as a source of continuity.
  125. 10:03Here's the problem with a lot of current agent infrastructure.
  126. 10:06Most agent harnesses today will treat the log as an afterthought.
  127. 10:10So, Claude code and Codex will write these messy JSONL files to local disk, and even in Claude SDK mode, those writes are fire and forget, which means that if for whatever reason the write fails, the data is gone.
  128. 10:24Open code's another example, they store state in a SQLite file, and there's a lot of GitHub issues around how there's corrupt state and data loss.
  129. 10:32Durable objects often end up holding different shards, that makes reconstructing history difficult, it makes querying across sessions difficult.
  130. 10:41And in all of these scenarios, the log is just a side effect, it's not the system.
  131. 10:46And that's a problem, because when you treat the log as a first-class citizen, it makes all of these properties become structural.
  132. 10:54You don't have to bolt them on, which is what it feels like is being done today, they all just fall out.
  133. 11:02The next point is incredibly important.
  134. 11:05This brings us to ownership.
  135. 11:07The strongest form, now that we've established that the log is the agent, the strongest form of lock-in isn't model lock-in.
  136. 11:15Models can be swapped.
  137. 11:17It's not API or tool lock-in either.
  138. 11:20Those can be wrapped, and those can be adapted.
  139. 11:22The deepest form of lock-in is actually log lock-in.
  140. 11:27If a provider owns your log, then the provider effectively owns your agent and long-term the log is the valuable part because the model is replaceable, the runtimes replaceable, the machines are replaceable,
  141. 11:40the log is the thing that persists.
  142. 11:43I have another slide for this because I think it's really worth taking seriously right now.
  143. 11:47Anthropic has Claude managed agents, Google has Gemini managed agents, every managed provider is going to own more of the stock.
  144. 11:55They're going to want to.
  145. 11:56They're going to want to have the hosted agent loop and manage memory and sand boxes and compaction and background agents.
  146. 12:03They're going to want to own your agents and agents are arguably the most intimate piece of technology you'll ever run.
  147. 12:11For an agent to be useful, it needs to have your personal data, your company's data, your workflows, your decisions.
  148. 12:19The log is the record of all of that and if it lives on someone else's infrastructure under their policies and queryable by their systems, they don't just host your agent.
  149. 12:29They own it.
  150. 12:31This is the architecture we have been building towards at Unara.
  151. 12:36We think of agent execution as the set of components that are coordinated around the log.
  152. 12:41The worker advances the loop, but the worker is not the agent, it's just the executor and it will call out to the model provider, it'll get its results, it'll write it back to the log
  153. 12:54and then if the model provider requires tools, it will go ahead and dispatch those tools to the right execution environment to finish somewhere else.
  154. 13:03The tools will complete and then those results will get appended back to the log and then a worker, most likely a different one, will then reconstruct the state and it'll continue
  155. 13:12and this is very important because this is how real agent systems will have to survive real-world failure because workers will crash, machines will restart, sandboxes disappear, tool calls will time out, providers will fail, users connect.
  156. 13:26There's so many different things that can go wrong.
  157. 13:29And if an agent is a running process, that's extremely terrifying.
  158. 13:33But if the agent is the log, it's simply an execution detail.
  159. 13:38And this is important because it's the core of what we're building.
  160. 13:44It's the core of the open-source managed agents platform that we're debuting.
  161. 13:48Everything will be built around the session log, which we will make sure that you can fully own, fully inspect, it's fully controlled by you.
  162. 13:58And that's something we believe in strongly.
  163. 14:02If you're interested, check it out at amnar.com/managed.
  164. 14:07It may be released by the time this recording comes out or there may still be a waitlist there.
  165. 14:13So, in closing, the main thing I want to leave you with is this.
  166. 14:17An agent is not just a model call, it's not just a prompt or a loop or a sandbox.
  167. 14:22It's not any of those things.
  168. 14:24The agent is the durable history of the work being done, and that history is the log.
  169. 14:28Once you start to see it this way, a whole lot of things fall into place.
  170. 14:33Reliability, compaction, forking, migration, multiplayer, ownership, scalability, so many things.
  171. 14:42Because you're going to stop treating the log as this exhaust from the system, and you're going to treat it as the system itself.
  172. 14:48And that's super important.
  173. 14:50So, if this was useful, stay tuned to what we're building at Amnara.
  174. 14:54We're getting ready to open source, as I mentioned, our managed agents platform, and you can join here.
  175. 14:59The log as the agent is just one of several pieces that we think are going to be making agents a whole lot more powerful in the future.
  176. 15:07So, thanks for tuning in.