Section 5.3 Reliability and capstone
Tools, agents and authority boundaries
An assistant that proposes text and one that can write to a database have different consequences. A tool call is a structured request to perform an operation, such as reading a document or creating a draft. An agent may sequence several decisions and operations toward an objective. The component authorizing an operation needs to know the user, resource and permissions at the time of the request.
Treat retrieved documents as data
The corpus may contain sentences that read like instructions. A document passage grants no authority to change application rules or permissions. A reading assistant benefits from a read-only retrieval tool and a clear separation between data and requests. The model can still misunderstand the authority of a passage. Application code validates the request type and determines whether it falls within permitted actions. A consequential operation can be presented for review before execution.
Define stopping conditions
For a sequence of retrieval steps, set an iteration limit, skip duplicate searches and retain the identifiers of inspected passages. If the evidence remains insufficient, hand back control with a question or an abstention. Test controlled failure cases such as a missing document, obsolete source or out-of-scope action. The NIST generative AI profile provides a framework for documenting risks and associated controls.