Combining Modular Skills in Multitask Learning — mentioned by edwardjhu

Fri, 24 Mar 2023 23:08:56 GMT

This paper tries something like that https://arxiv.org/pdf/2202.13914.pdf The gain isn't that significant. We don't understand what these low-rank updates represent, and they might not correspond to "skills" that humans have.

Paper and discussion history. A mention is not an endorsement.

Combining Modular Skills in Multitask Learning · HackerPapers discussions

Combining Modular Skills in Multitask Learning — mentioned by edwardjhu