Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision — mentioned by gwern

Thu, 04 Mar 2021 22:25:16 GMT

DALL-E is 250m: https://arxiv.org/pdf/2102.12092.pdf#page=14 (so 20x larger). CLIP (https://cdn.openai.com/papers/Learning_Transferable_Visual_M...) is 400m (34x larger). And ALIGN (https://arxiv.org/abs/2102.05918#google) is 1800m (155x). (For 47m maybe you're thinking of a cleaned subset from YFCC100M or something that one of them used, but they all use total images an order or two larger than Wit.)

Paper and discussion history. A mention is not an endorsement.

Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision — mentioned by gwern

Wed, 17 Feb 2021 02:37:57 GMT

You can make the CNN focus more on shape rather than photographic texture using style transfer, hence, Stylized-Imagenet: https://arxiv.org/abs/1811.12231 I've wondered if you could do the same thing with anime images as well, and if a joint classifier (using, say, https://www.gwern.net/Danbooru2020 ?) would be much better for it. Of course, the big trend now is CLIP/ALIGN https://openai.com/blog/clip/ https://arxiv.org/abs/2102.05918#google which are trained on web images on such a scale that they do quite fine on anime images. Look on Twitter or Reddit for 'Big Sleep' examples using the…

Paper and discussion history. A mention is not an endorsement.

Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision · HackerPapers discussions

Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision — mentioned by gwern

Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision — mentioned by gwern