How AI works AI Dictionary

Inference

The moment a trained AI model is actually used to produce an answer or result.

Training is when the model learns; inference is when it works for you. Every prompt you send triggers inference.

Example

Clicking “Generate” in a video tool starts inference.

Why it matters to you

Inference costs are why many tools limit how much you can generate.

Related terms

GPUA computer chip that can do many calculations at the same time, which makes it ideal for AI. ModelThe trained “brain” of an AI tool: the file that has learned patterns and produces results. Training DataThe examples an AI model learns from.