Diffusion-Based Neural Network Weights Generation — mentioned by _bobm

Mon, 02 Nov 2026 20:57:19 GMT

I think the subfield has been there for a long time. See a small section of papers on the topic of generating dynamic weights during inference, predicting weights from network architecture, and learning the distribution of previously trained network parameters, just to name a few keywords: Parameter Prediction for Unseen Deep Architectures [1] NeuroGen: Neural Network Parameter Generation via Large Language Models [2] Diffusion-Based Neural Network Weights Generation [3] The critical thing to me is that Astra is capable of doing it. I don't know if it was trained to do so. All this does not…

Paper and discussion history. A mention is not an endorsement.

Diffusion-Based Neural Network Weights Generation — mentioned by space_fountain

Mon, 02 Nov 2026 20:53:14 GMT

Research on using LLMs and diffusion models to directly predict weights have been going on for a bit now for example https://arxiv.org/pdf/2402.18153

Paper and discussion history. A mention is not an endorsement.

Diffusion-Based Neural Network Weights Generation · HackerPapers discussions

Diffusion-Based Neural Network Weights Generation — mentioned by _bobm

Diffusion-Based Neural Network Weights Generation — mentioned by space_fountain