Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts — mentioned by redeyedtreefrog

Thu, 05 Sep 2024 11:05:06 GMT

The names of their researchers are on this recent paper: https://arxiv.org/pdf/2408.15664 Their terms of service say "The DeepSeek Open Platform is jointly owned and operated by Hangzhou DeepSeek Artificial Intelligence Co., Ltd., Beijing DeepSeek Artificial Intelligence Co., Ltd. " And they're funded by https://www.high-flyer.cn/en/fund/ which the FT did an article on: https://www.ft.com/content/357f3c68-b866-4c2e-b678-0d075051a... In terms of the personal data you share when using their models, I can't see why they would be any more or less nefarious than big Western tech companies. That…

Paper and discussion history. A mention is not an endorsement.

Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts · HackerPapers discussions

Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts — mentioned by redeyedtreefrog