Build apps that describe images with BLIP-2.
Guides developers in building image captioning, visual question answering, and image retrieval with BLIP-2.
When to use it
Use for image captioning, visual question answering, zero-shot image understanding, multimodal conversations, or image-text retrieval.
It changes how the agent implements BLIP-2 image captioning, visual question answering, and image retrieval in project code.
What you provide
Requires Python to run the provided implementation examples; no Python version requirement is stated.
The recommended Transformers captioning example requires a CUDA-capable GPU because it moves inputs to CUDA in FP16.
This skill
HuggingFace
Downloads BLIP-2 model files
pip install transformers accelerate torch Pillow
Installs vision-language Python packages