Glossary · Technical concept

Inference

The phase in an AI system's lifecycle where the trained model is applied to new inputs to produce outputs. Distinct from training (where weights are learned). Inference is the runtime-facing surface where most user-visible risks (latency, cost, hallucination, prompt injection) manifest.

Framework references

  • NIST AI RMF lifecycle

Relevant Responsible AI Studio tools

More technical concept terms

See the full 80-term glossary →