Software Development
BLIP 2 Vision Language
Explains how to use Salesforce BLIP-2 (Q-Former bridging a frozen image encoder and an LLM such as OPT or FlanT5) through HuggingFace Transformers and LAVIS for image captioning, visual question answering, image-text matching, and feature extraction. Use when generating captions for images, building a VQA system, doing zero-shot image-text understanding without task-specific training, matching or retrieving images against text, or fitting a BLIP-2 model into limited GPU memory with INT8/INT4 quantization. Prefer LLaVA or InstructBLIP for instruction-following multimodal chat, and CLIP for plain image-text similarity.
- Publisher / source
- KalarisLabs/research-agent-skills (found on the CSV list)
- Upstream record
- KalarisLabs/research-agent-skills
- Version
- Version 2
- Published
- Publication review
- Approved for publication
- Content fingerprint
e694436aff31afe5c6064c72754788e5ad1250d98080d955e9941cb2f03b6219