Inference
Running a trained model to produce an output. Inference cost and latency, not training, dominate the economics of most production AI features.
Related terms
Large Language Model (LLM)
Retrieval-Augmented Generation (RAG)
Vector Database
Embedding
Fine-tuning
Prompt Engineering
Need the team behind the term?
Scope your need →