Foundation Models for Natural Language Processing -- Pre-trained Language Models Integrating Media — mentioned by sfriedr

Thu, 15 Jun 2023 08:51:56 GMT

Congratulation, great paper! It should have been put on HN earlier ;) I have a few questions: * you say (page 4): "We then perform standard instruction finetuning on the base LLaMA-7B model" Could you perhaps provide a reference to the _exact_ finetuning approach you used? I'm afraid different groups of people have a different notion of "standart" (see for example pages 131-155 from https://arxiv.org/abs/2302.08575 for various fine-tuning approaches) and without knowing exactly how fine-tuning was carried out, it can be very difficult reproduce your research and results exactly. * the idea of…

Paper and discussion history. A mention is not an endorsement.

Foundation Models for Natural Language Processing -- Pre-trained Language Models Integrating Media · HackerPapers discussions

Foundation Models for Natural Language Processing -- Pre-trained Language Models Integrating Media — mentioned by sfriedr