LoRA (Low-Rank Adaptation)
A lightweight fine-tuning method that adapts large AI models by training only a small number of additional parameters instead of the entire model. Makes custom model training affordable and fast — even on consumer hardware.
Why it matters
LoRA makes customizing an AI model affordable. Instead of retraining billions of parameters, which costs enormous compute, it trains a small add-on, so hobbyists and small teams can teach a model a specific style or task on modest hardware. This is why communities can share thousands of tiny specialized files, letting one base model take on countless personalities and skills without duplicating the whole thing.
In practice
An indie illustrator wants an image model to draw in their signature style. They train a LoRA on a few dozen of their own drawings, producing a small file they can layer onto a standard base model. Now the model outputs art in their style on demand. The same idea applies to text models, where a LoRA can specialize one in legal or medical phrasing without a full retrain.
Related terms
AI Dubbing
Automated translation and re-voicing of audio/video content into other languages while preserving the original speaker's voice characteristics, timing, and emotional delivery.
AI Orchestration
Coordinating multiple AI models, tools, and data sources in a unified pipeline. An orchestration layer manages prompt routing, context passing, error handling, and output aggregation across different AI services.
API (Application Programming Interface)
A way for software applications to communicate with each other. AI APIs let developers integrate AI capabilities into their own applications programmatically.
Attention Mechanism
A technique that allows AI models to focus on the most relevant parts of input data when generating output. In language models, attention determines which words in a sentence are most important for understanding each other word.
Diffusion Model
A type of generative AI that creates images by gradually removing noise from a random starting point. Powers tools like Stable Diffusion, DALL-E, and Midjourney. Works by learning the reverse of a noise-adding process.
Distillation
A technique where a smaller 'student' model learns to replicate the behavior of a larger 'teacher' model. Produces compact models that retain most of the teacher's capability while being faster, cheaper, and deployable on smaller devices.