RS Glossary
Inference
Inference is the process of running a trained model on an input to produce a prediction, classification, generation, or other output.
- Review state
- Needs review
- Freshness
- Current
- Version
- 2
- Inference
- Model Inference
Remember it this wayTraining changes the model; inference uses it.
In plain language
Training is when the model's learned values are adjusted. Inference is when the trained model is used, such as when it answers a prompt or analyzes a new image.
Why it matters
Inference determines run-time speed, cost, hardware needs, privacy exposure, and how a model is integrated into a real workflow.
Example
When a user submits a prompt and the model generates a response, the model is performing inference.
Common misconception
Ordinary inference does not necessarily update the model's weights or make it learn permanently from each request.
Related terms
Sources
- Google for Developers, *Machine Learning Glossary: Inference*technical definition of applying a trained model to unlabeled examples to make predictions.
- NIST, *Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations* (NIST AI 100-2 E2025)lifecycle terminology distinguishing training and inference stages.
Learn more
- Connect run-time behavior to [[latency|Latency]] and [[compute|Compute]].
Public history
36 recorded events · 36 public summaries
A potential shared concept was discussed and selected for initial glossary drafting.
The captured candidate received a complete initial draft and entered section-level human review.
Radar reviewed the initial definition draft for human consideration.
Radar reviewed the initial plain-language-explanation draft for human consideration.
Radar reviewed the initial why-it-matters draft for human consideration.
Radar reviewed the initial example draft for human consideration.
Radar reviewed the initial common-misconception draft for human consideration.
Radar reviewed the initial remember-it-this-way draft for human consideration.
Radar reviewed the initial related-terms draft for human consideration.
Radar reviewed the initial sources draft for human consideration.
Radar reviewed the initial learn-more draft for human consideration.
A proposal was opened for section-level human review while preserving the current version.
A human reviewer opened a proposed revision while preserving the current approved or captured version.
plain-language-explanation approved by a human reviewer.
why-it-matters approved by a human reviewer.
example approved by a human reviewer.
common-misconception approved by a human reviewer.
remember-it-this-way approved by a human reviewer.
related-terms approved by a human reviewer.
sources returned for revision.
learn-more approved by a human reviewer.
Requested wording was prepared without changing approved or existing sections.
Radar reviewed the pending sources section for human consideration.
Radar must rereview the complete inference term after an accepted text change.
Radar must rereview the complete inference term after an accepted text change.
Radar must rereview the complete inference term after an accepted text change.
Radar must rereview the complete inference term after an accepted text change.
Radar must rereview the complete inference term after an accepted text change.
Radar must rereview the complete inference term after an accepted text change.
Radar must rereview the complete inference term after an accepted text change.
Radar must rereview the complete inference term after an accepted text change.
Radar must rereview the complete inference term after an accepted text change.
definition approved by a human reviewer.
sources approved by a human reviewer.
sources approved wording became the current section text.
All section gates are approved; content version 2 is now a fully approved term.
Source: vault/Glossary/terms/inference/term.md · sha256:cd8e06e76add62f8f39f078cbebd2473aa54b23a52618640f514f59974532da2 · Release: rs-glossary-glossary-team-poc-0.5.5-2026-09-02