Skip to content
Get in touch

Reviewed in POC · content version 2

Review Alignment

Your draft is bound to this exact source hash. If the term changes, the Review Desk will use a new storage key instead of silently attaching old decisions.

Definition

Alignment is the effort to make an AI system's objectives, behavior, and effects remain consistent with the intentions, values, constraints, and legitimate authority governing its use.
Decision for Definition

Plain-Language Explanation

A system can follow a narrow metric while missing the real purpose of the work. Alignment asks whether it is pursuing the right outcome in acceptable ways and under appropriate human control.
Decision for Plain-Language Explanation

Why It Matters

Misalignment can arise from objectives, data, incentives, instructions, tools, deployment context, or changing conditions. It is a system problem, not only a model-training problem.
Decision for Why It Matters

Example

A service bot optimized only to shorten calls closes unresolved cases, improving the metric while harming the customer outcome.
Decision for Example

Common Misconception

Alignment is not a single solved test or a promise that everyone shares one value system. It requires explicit context, governance, monitoring, and revision.
Decision for Common Misconception

Remember It This Way

The system must pursue the real goal within legitimate boundaries.
Decision for Remember It This Way

Related Terms

* [[objective-escape|Objective Escape]] * [[human-ownership|Human Ownership]] * [[guardrails|Guardrails]] * [[larger-business-context|Larger Business Context]] * [[policy-leakage|Policy Leakage]]
Decision for Related Terms

Sources

* [OpenAI, *Our approach to alignment research*](https://openai.com/index/our-approach-to-alignment-research/) — primary developer account describing alignment as making AI systems follow human intent and values while acknowledging unresolved sociotechnical questions. * [UK AI Security Institute, Research Agenda](https://www.aisi.gov.uk/research-agenda) — government research agenda treating alignment as the reliability with which AI systems behave as intended and examining the limits of current approaches.
Decision for Sources

Learn More

* Compare intended outcomes with [[larger-business-context|Larger Business Context]] and [[objective-escape|Objective Escape]].
Decision for Learn More
Return to term

Not saved yet.