An autonomous system should earn confidence through explicit claims, measurable evidence, bounded authority, and behavior that remains dependable when conditions change.
Framework statusResearch concept · Open to critique
[ 01 — THE PREMISE ]
Autonomy changes the burden of proof.
When software can perceive, decide, and act with limited human intervention, conventional assurances are no longer enough.
Trust must be attached to a defined system, mission, environment, and period of operation. It should be supported by inspectable evidence—not reputation, intention, or a one-time test.
[ 02 — THE TRUST MODEL ]
Four conditions for warranted confidence.
Select a condition to inspect the central question it answers.
01Trust condition
Claims must be explicit.
Define the behavior, safety, security, resilience, and accountability outcomes the system is expected to deliver. A claim that cannot be tested or challenged cannot support trust.
Scope
Mission-specific
Owner
Named and accountable
Quality
Testable and falsifiable
[ 03 — CONTINUOUS ASSURANCE ]
Confidence should move with the evidence.
01Define
State the mission, claims, operating limits, and accountable parties.
02Observe
Collect relevant technical, operational, and human evidence.
03Evaluate
Compare observed behavior with explicit acceptance criteria.
04Respond
Constrain, correct, recover, or stop when confidence degrades.
“Trusted” should describe the strength of the current evidence for a bounded use—not a permanent label attached to a technology.
Working principle 03
[ 04 — FAILURE-AWARE BY DESIGN ]
A trustworthy system must know when not to act.
Safe autonomy depends on more than successful operation. It requires detectable limits, graceful degradation, meaningful human intervention, and evidence preserved for review.
F.01Uncertain perceptionReduce authority or request review
F.02Policy conflictStop, explain, and escalate
F.03Evidence gapWithhold the trust claim
F.04Operating driftRe-evaluate the assurance case
[ 05 — RESEARCH AGENDA ]
From abstract trust to operational proof.
R / 01
Assurance cases
Connect system-level trust claims to evidence that can be examined, challenged, and updated.
Claims · arguments · evidence
R / 02
Bounded autonomy
Define observable operating limits and verifiable mechanisms that keep authority inside them.
Scope · constraints · control
R / 03
Resilient infrastructure
Examine how distributed compute, cloud services, and edge systems sustain trustworthy operation.
Cloud · edge · continuity
R / 04
Evidence engineering
Make assurance evidence reliable, traceable, decision-relevant, and available when it matters.
Telemetry · provenance · review
[ 06 — PARTICIPATE ]
Help make trust demonstrable.
This initiative is being developed as an independent research concept. Constructive critique, research collaboration, and practical use cases are welcome.