HackerPapers

arXiv:2012.03772cs.LG

Continuum Limit of Lipschitz Learning on Graphs

Tim Roith, Leon Bungert

Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.

Abstract

Tackling semi-supervised learning problems with graph-based methods has become a trend in recent years since graphs can represent all kinds of data and provide a suitable framework for studying continuum limits, e.g., of differential operators. A popular strategy here is $p$-Laplacian learning, which poses a smoothness condition on the sought inference function on the set of unlabeled data. For $p<\infty$ continuum limits of this approach were studied using tools from $Γ$-convergence. For the case $p=\infty$, which is referred to as Lipschitz learning, continuum limits of the related infinity-Laplacian equation were studied using the concept of viscosity solutions. In this work, we prove continuum limits of Lipschitz learning using $Γ$-convergence. In particular, we define a sequence of functionals which approximate the largest local Lipschitz constant of a graph function and prove $Γ$-convergence in the $L^\infty$-topology to the supremum norm of the gradient as the graph becomes denser. Furthermore, we show compactness of the functionals which implies convergence of minimizers. In our analysis we allow a varying set of labeled data which converges to a general closed set in the Hausdorff distance. We apply our results to nonlinear ground states, i.e., minimizers with constrained $L^p$-norm, and, as a by-product, prove convergence of graph distance functions to geodesic distance functions.

arXiv comments
39 pages, added acknowledgement, corrected typos
Journal reference
Found Comput Math (2022)
DOI
doi:10.1007/s10208-022-09557-9
Subjects
cs.LGMachine Learning math.APAnalysis of PDEs math.NANumerical Analysis stat.MLMachine Learning (Statistics)

On Hacker News

Linked by 1 identifiable commenter in 1 comment across 1 thread, from Dec 2021 to Dec 2021.

Comments linking this paper, per year.

Discussed in comments1 thread

    • A simple way to do SSL with not enough data is Lipschitz learning. It avoids the necessity for pseudo-labeling and computes an absolutely minimizing Lipschitz extension of the labels instead. https://arxiv.org/abs/2111.12370 https://arxiv.org/abs/2012.03772…

      WAMoezartView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.