Flamingo: a Visual Language Model for Few-Shot Learning · HackerPapers discussions

Flamingo: a Visual Language Model for Few-Shot Learning — mentioned by Animats

Wed, 01 Oct 2025 19:28:43 GMT

The underlying work is something called "Flamingo".[1] This is a system for understanding interleaved text and images in sequence. So it can process two "modalities" that are both sequential. This new work seems to put some kind of time token in one "modality" channel, leading to more awareness of time. (The web site is too cute. Applying a left to right gradient on text is a bit much.) [1] https://arxiv.org/pdf/2204.14198

Paper and discussion history. A mention is not an endorsement.

Flamingo: a Visual Language Model for Few-Shot Learning — mentioned by famouswaffles

Thu, 22 Feb 2024 15:36:03 GMT

This explanation is wrong as I've already said (256 is not the result of any conversion to text) but no one has to take my word for it. From the Gemini report https://arxiv.org/abs/2312.11805 >The visual encoding of Gemini models is inspired by our own foundational work on Flamingo (Alayrac et al., 2022), CoCa (Yu et al., 2022a), and PaLI (Chen et al.,2022), with the important distinction that the models are multimodal from the beginning and can natively output images using discrete image tokens (Ramesh et al., 2021; Yu et al., 2022b). These are the papers Google say the multimodality in…

Paper and discussion history. A mention is not an endorsement.

Flamingo: a Visual Language Model for Few-Shot Learning — mentioned by edouard-harris

Thu, 12 May 2022 21:10:33 GMT

That Tim Urban piece is great. It's also an interesting time capsule in terms of which AI problems were and were not considered hard in 2015 (when the post was written). From the post: > Build a computer that can multiply two ten-digit numbers in a split second—incredibly easy. Build one that can look at a dog and answer whether it’s a dog or a cat—spectacularly difficult. Make AI that can beat any human in chess? Done. Make one that can read a paragraph from a six-year-old’s picture book and not just recognize the words but understand the meaning of them? Google is currently spending…

Paper and discussion history. A mention is not an endorsement.