What Trustworthy AI Review Actually Means

OpenCodeReview’s central promise is not that a language model will find every defect. It is that AI review can become more useful when the parts that must remain stable—scope, policy, budgets, locations, coverage, and publication—are controlled by engineering around the model. This final synthesis asks what that makes “trustworthy” mean in practice, how the trade-offs should guide adoption, and which decisions must remain human even when the system is fast and well integrated.

The answer is a property of the whole path. A smart comment from an unverified ref is weak evidence. A complete-looking result that silently excluded a risky file is weak evidence. A correctly anchored comment that was duplicated or attached to a newer head than the one reviewed is weak evidence. Trust begins when each stage says what it did, what it did not do, and which part of the judgment still belongs to a person.

Trust is a property of the whole review path

OpenCodeReview’s deterministic/agent split is valuable because it assigns different kinds of uncertainty to different owners. Git-aware code establishes the change and the post-change file state. Selection and rules establish the admissible scope and the concerns that should guide review. Grouping and phase boundaries give the agent context without giving it an unlimited repository conversation. The model then interprets the selected evidence, while deterministic anchoring checks whether a comment can be connected to code. Session manifests and publication layers preserve what happened after the model stopped.

This does not turn the pipeline into a formal proof of correctness. It makes the evidence behind a conclusion inspectable. A complete manifest means every selected item reached a terminal outcome relative to that selection; it does not mean every repository file was selected, every model conclusion was correct, or every external requirement was understood. An inline comment means the location passed an anchoring and publication path; it does not mean the comment’s reasoning is automatically true.

That distinction is the difference between trust in a process and belief in an output. Belief in an output asks whether a particular comment sounds convincing. Trust in the process asks whether the comment came from the intended change, under the intended policy, with a location grounded in the diff, and with any delivery uncertainty exposed. The second question is less glamorous, but it is the one a team needs when review results become part of a merge or release decision.

The system’s boundaries also make surprising outcomes explainable. If a test file is missing, selection may have excluded it. If a large source file is absent, the prompt-size gate may have stopped it before an LLM request. If a related service was reviewed without its handler, grouping may have split the files or fallen back to single-file tasks. If a comment appears only in a summary, anchoring or publication may not have proved a safe inline location. Each explanation points to a different corrective action. A longer prompt is not the remedy for every failure.

This is why the project’s insistence on deterministic engineering is more than an implementation preference. It creates a chain of accountable transitions:

  • Evidence identity: which workspace, commit, or range was reviewed, and which post-change state supplied context.
  • Policy identity: which paths survived, which were excluded, and which rule layer governed each file.
  • Context identity: which files shared a group, what tools and phases were available, and where the group limits applied.
  • Finding identity: which code excerpt supported a comment, whether it was uniquely locatable, and whether a filter removed it.
  • Coverage identity: which selected items completed, were reused, failed, or never reached a terminal outcome.
  • Delivery identity: whether the finding was posted inline, routed to a summary, skipped by history, or left uncertain after an API failure.

No single identity is sufficient. Together they define what a review result can responsibly claim.

Trust requires trade-offs, not a promise of maximal detection

OpenCodeReview explicitly chooses a point on the precision–recall–cost frontier.