Distributed Deep Learning Using Volunteer Computing-Like Paradigm — mentioned by mindcrime

Sat, 24 Dec 2022 11:14:36 GMT

There are a handful of "open source LLM" initiatives out there, although I don't think any of them are quite up to the level of ChatGPT. Possibly one of the more interesting ones is GLM-130B. https://github.com/THUDM/GLM-130B Released by some folks at Tsinghua University in China, back in August. The model itself is licensed under some janky "free to use, but not open source" license, but it looks like most of the code for training, evaluation, etc. is available and licensed under either the Apache License or a BSD-like license. You might also find this of interest…

Paper and discussion history. A mention is not an endorsement.

Distributed Deep Learning Using Volunteer Computing-Like Paradigm · HackerPapers discussions

Distributed Deep Learning Using Volunteer Computing-Like Paradigm — mentioned by mindcrime