Computer VisionLesson 5
Lesson 59 min
CLIP (Text + Image)
Connecting images and language in one shared space.
What you will learn
- ✓How CLIP links text and images
- ✓Zero-shot classification
- ✓Why it powers image search and generators
Explanation
CLIP trains an image encoder and a text encoder together so that a picture and its description land near each other in the same embedding space.
That enables zero-shot classification — you can ask 'is this a cat or a dog?' without training on those specific labels — and powers text-to-image search.
CLIP-style models are a key ingredient behind image generators and multimodal search.
Real-world use
Searching your photo library by typing 'beach sunset' uses CLIP-style image-text embeddings, not filenames.
Common mistakes
- • Thinking you must retrain for every new label — CLIP enables zero-shot recognition.
Practice
Describe how CLIP would let you search a photo album by a typed phrase.
Knowledge check
0/1 answered1. CLIP's key idea is to...
Answer all questions to check.