HackerPapers

arXiv:2301.12530cs.LG

G-Rank: Unsupervised Continuous Learn-to-Rank for Edge Devices in a P2P Network

Andrew Gold, Johan Pouwelse

Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.

Abstract

Ranking algorithms in traditional search engines are powered by enormous training data sets that are meticulously engineered and curated by a centralized entity. Decentralized peer-to-peer (p2p) networks such as torrenting applications and Web3 protocols deliberately eschew centralized databases and computational architectures when designing services and features. As such, robust search-and-rank algorithms designed for such domains must be engineered specifically for decentralized networks, and must be lightweight enough to operate on consumer-grade personal devices such as a smartphone or laptop computer. We introduce G-Rank, an unsupervised ranking algorithm designed exclusively for decentralized networks. We demonstrate that accurate, relevant ranking results can be achieved in fully decentralized networks without any centralized data aggregation, feature engineering, or model training. Furthermore, we show that such results are obtainable with minimal data preprocessing and computational overhead, and can still return highly relevant results even when a user's device is disconnected from the network. G-Rank is highly modular in design, is not limited to categorical data, and can be implemented in a variety of domains with minimal modification. The results herein show that unsupervised ranking models designed for decentralized p2p networks are not only viable, but worthy of further research.

arXiv comments
12 pages, 9 figures, Johan Pouwelse is my thesis supervisor
Journal reference
DOI
Subjects
cs.LGMachine Learning

On Hacker News

Linked by 1 identifiable commenter in 3 comments across 3 threads, from Jan 2023 to Sep 2026.

Comments linking this paper, per year.

Discussed in comments3 threads

    • Using the term AGI and not including any performance analysis. My AI calls it: "massive marketing overreach". Somebody called this slop in the comments. As a professor who published on continual learning I'm leaning towards agreement[1]. It lacks any substance. No relation to…

      synctextView on HNParent context

    • Thnx for writing! In academia we're getting the next step operational: training on Android. Any advise for us what to watch out for? Obviously you need a bit of patience and lots of volunteer devices. With unsupervised continuous learning this is solved, in emulation. See…

      synctextView on HNParent context

    • Fascinating material, significant progress in learn-to-rank and semantic clustering lately. For those who want to dive deeper, state-of-the-art decentralised learning from academia: https://arxiv.org/abs/2301.12530 "G-Rank: Unsupervised Continuous Learn-to-Rank for Edge Devices…

      synctextView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.