Efficient Image Generation with Variadic Attention Heads · HackerPapers discussions

Efficient Image Generation with Variadic Attention Heads — mentioned by godelski

Sat, 09 Aug 2025 22:31:25 GMT

Sure. This was the paper[0]. Here's a few more you might find these interesting. Google's Transformer GAN[1] (not a transformer at all resolutions). Diffusion-GAN[2] is a hybrid architecture. Remember that technically the GAN process can use any underlying architecture. Arguably you could say some of the training steps in LLMs are GANs. And I think this one is also interesting in a similar respect[3]. Before PWC went down, StyleSAN[4] was the SOTA on FFHQ, but IIRC this doesn't change the architecture so it should probably work on all the other architectures too (comes with compute costs, but…

Paper and discussion history. A mention is not an endorsement.

Efficient Image Generation with Variadic Attention Heads — mentioned by stevenwalton

Fri, 19 Jul 2024 19:04:04 GMT

> But the constraint that both eyes should have consistent reflection patterns is just another statistical regularity that appears in real photographs Hi, author here of a model that does really good on this[0]. My model is SOTA and has undergone a third party user study that shows it generates convincing images of faces[1]. AND my undergrad is in physics. I'm not saying this to brag, I'm giving my credentials. That I have deep knowledge in both generating realistic human faces and in physics. I've seen hundreds of thousands of generated faces from many different models and architectures. I…

Paper and discussion history. A mention is not an endorsement.