PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs
We introduce PIN, a learned spatial prompt that enables frozen vision–language models to localize objects. Training uses synthetic data and next-token prediction, without manually annotated detection data.
Adaptation of OpenFlamingo and BLIP-2 · Zero-shot object localization