One Question, Three Layers, One Decision
Hindsight's first three stages can be understood as one operating path rather than separate features. This checkpoint connects retain, connected facts, and observation consolidation through a single incident question: what happened, why did it happen, and what should an agent use as evidence next? The useful judgment is not to repeat the definitions of each layer, but to decide what each layer can safely answer and how provenance and scope change that decision.
A question enters as a conversation
Imagine a project assistant receives a support exchange about an API incident. An engineer says that the team changed a retry policy on Tuesday to reduce latency, that the service later experienced timeouts under load, and that a rollback restored normal behavior. The message includes a screenshot with a request identifier. In a later exchange, the engineer says that the change affected only the Atlas project and that the assistant had previously recommended the policy.
The exchange is one piece of conversation to the caller, but it contains several kinds of information. There is a world fact about a project and an incident. There is an event date and a time when the bank learned about it. There is a possible causal chain from the policy change to the timeout and from the rollback to recovery. There is an entity path through the Atlas project, the API, the retry policy, and the request identifier. There is also an agent experience: the assistant's earlier recommendation. The screenshot is not merely a file beside the text; it may be the only source of the request identifier.
Retain turns that exchange into raw memory units with different perspectives and metadata. It can represent the engineer's report as a world fact rather than treating every first-person sentence in the transcript as the assistant's experience. It can attach the screenshot only to the fact that required it. It can preserve the incident's occurrence time separately from the time the support exchange was retained. The raw representation is more structured than the original message, but it remains close enough to the source that a reader can check what was actually said.
The raw set may contain several facts from one exchange, not one master conclusion. One fact can state that the retry policy was changed; another can record the timeout; a third can describe the rollback. If the engineer later corrects the date or says the timeout affected only one load pattern, that correction is new evidence with its own context. Keeping the statements separate gives consolidation something to compare and gives an operator a way to see whether a later observation preserved the qualification. A single pre-written summary would be easier to read, but it would hide which detail changed.
The path can be pictured as a sequence of decisions:
The diagram's important feature is the branch after connected raw memories. The observation path is not a replacement path.