HackerPapers

arXiv:2012.06333cs.LG

Sheaf Neural Networks

Jakob Hansen, Thomas Gebhart

Abstract

We present a generalization of graph convolutional networks by generalizing the diffusion operation underlying this class of graph neural networks. These sheaf neural networks are based on the sheaf Laplacian, a generalization of the graph Laplacian that encodes additional relational structure parameterized by the underlying graph. The sheaf Laplacian and associated matrices provide an extended version of the diffusion operation in graph convolutional networks, providing a proper generalization for domains where relations between nodes are non-constant, asymmetric, and varying in dimension. We show that the resulting sheaf neural networks can outperform graph convolutional networks in domains where relations between nodes are asymmetric and signed.

arXiv comments
NeuRips 2020 Workshop on TDA and Beyond
Journal reference
DOI
Subjects
cs.LGMachine Learning math.ATAlgebraic Topology

On Hacker News

Linked by 2 identifiable commenters in 2 comments across 2 threads, from Aug 2021 to Jun 2024.

Comments linking this paper, per year.

Discussed in comments2 threads

    • There's been a decent amount of work using simplicial complexes and related ideas to generalize graph neural networks, e.g. [0], [1]. If LLMs obey a similar geometry, it could be a promising direction for multimodal models and more principled RAGs with better inductive biases.…

      mjhayView on HNParent context

    • At least there is work on greatly generalizing convolutions. They're much more broadly applicable (in neural networks) to very differently structured data than they appear to be in their standard form. (The "in neural networks" qualifier is there because quite a bit of this has…

      gsprView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.