PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models · HackerPapers discussions

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models — mentioned by potatoman22

Thu, 22 Dec 2022 04:10:15 GMT

It's from an algorithm called PULSE. It seems to search the latent space of StyleGAN to find a face that compresses to something similar to the query image. https://arxiv.org/pdf/2003.03808.pdf https://www.theverge.com/21298762/face-depixelizer-ai-machin...

Paper and discussion history. A mention is not an endorsement.

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models — mentioned by godelski

Mon, 23 May 2022 21:45:58 GMT

That's because we're still bad about long-tailed data and that people outside the research don't realize that we're first prioritizing realistic images before we deal with long-tailed data (which is going to be the more generic form of bias). To be honest, it is a bit silly to focus on long-tailed data when results aren't great. That's why we see the constant pattern of getting good on a dataset and then focusing on the bias in that dataset. I mean a good example of this is the Pulse[0][1] paper. You may remember it as the white Obama. This became a huge debate and it was pretty easily shown…

Paper and discussion history. A mention is not an endorsement.

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models — mentioned by godelski

Wed, 02 Feb 2022 01:59:50 GMT

I'm not sure why PULSE is being called out here. This is extremely common on any super-resolution trained on extremely biased datasets like FFHQ. In fact, this discussion is something that led to the dataset being changed. The authors actually extended their research to discuss the bias[0]. I'll also link to the Reddit discussion[1]. IMO the authors here responded to this correctly. It is important to remember that algorithms are only good on their in distribution datasets. And kudos on the authors for doing more experiments and including work on a less racially and sexually biased dataset.…

Paper and discussion history. A mention is not an endorsement.

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models — mentioned by jcims

Wed, 01 Jul 2020 03:31:25 GMT

The underlying (racially biased) superresolution algorithm was called PULSE and the code was released as an artifact of this paper: Paper: https://arxiv.org/pdf/2003.03808v1.pdf Here are the authors: Sachit Menon, Alexandru Damian, Shijia Hu, Nikhil Ravi, Cynthia Rudin They conveniently captured an image of them all in one place for us here - https://cdn.telanganatoday.com/wp-content/uploads/2020/06/Au... Pretty diverse team if you ask me. Sprinkling underrepresented (and therefore 'underpowered') representation into engineering teams will solve a lot of issues, but I think it has yet to be…

Paper and discussion history. A mention is not an endorsement.

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models — mentioned by jcims

Wed, 24 Jun 2020 22:18:01 GMT

One of the underlying models, PULSE, was trained on CelebAHQ, which is likely what the results are mostly white-looking. StyleGAN, which was trained on the much more diverse (but sparse) FFHQ dataset does come up with a much more diverse set of faces[1]...but PULSE couldn't get them to converge very closely on the pixelated subjects...so they went with CelebA [2]. [1] https://github.com/NVlabs/stylegan [2] https://arxiv.org/pdf/2003.03808.pdf (ctrl+f ffhq)

Paper and discussion history. A mention is not an endorsement.

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models — mentioned by OkGoDoIt

Wed, 17 Jun 2020 21:41:05 GMT

This animation gives a good overview of what it is doing: https://raw.githubusercontent.com/adamian98/pulse/master/rea... Basically it generates an upsampled image using a generative network, then downsamples it again to see how different it is from the original. It then tweaks the upsampled image (by moving around in the latent space of the generative model) until the downsampled version matches the original as closely as possible. Seems like it works really well, but only for faces. I wonder if the same technique could be applied to a broader domain of images? The actual paper can be found…

Paper and discussion history. A mention is not an endorsement.

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models — mentioned by headalgorithm

Sat, 13 Jun 2020 19:07:05 GMT

Paper: https://arxiv.org/abs/2003.03808

Paper and discussion history. A mention is not an endorsement.