LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention — mentioned by usrbinbash

Mon, 05 Jun 2023 07:20:07 GMT

> Running a remote cloud LLM costs about nothing in dollars to the user. The user doesn't care where it runs, because the user interacts with my product, not my backend. He also doesn't pay my cloud provider, he pays me. I think we don't need to argue the fact that an on premise solution is cheaper than a cloud solution for a lot of tasks, especially when talking about bounded resources. There is some convenience in setup, and some maintenance tasks are easier, but this comes at significant costs, especially as projects get larger. > Hopefully being based on more than predictions of local LLM…

Paper and discussion history. A mention is not an endorsement.

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention — mentioned by bitL

Sat, 22 Apr 2023 17:49:25 GMT

Yes, those adapters. There are many types now, most recently LLaMA adapter: https://arxiv.org/abs/2303.16199

Paper and discussion history. A mention is not an endorsement.

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention · HackerPapers discussions

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention — mentioned by usrbinbash

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention — mentioned by bitL