BloombergGPT: A Large Language Model for Finance · HackerPapers discussions

BloombergGPT: A Large Language Model for Finance — mentioned by teleforce

Sun, 07 May 2023 02:03:38 GMT

Two notable pioneers in this field are Bloomberg and Stochastic AI: 1) BloombergGPT: a) Introducing BloombergGPT, Bloomberg’s 50-billion parameter large language model, purpose-built from scratch for finance: https://www.bloomberg.com/company/press/bloomberggpt-50-bill... b) BloombergGPT: A Large Language Model for Finance: https://arxiv.org/abs/2303.17564 2) Stochastic AI: a) xFinance: How to outperform BloombergGPT without breaking the bank: https://www.stochastic.ai/blog/xfinance-vs-bloomberg-gpt/ b) xTuring website: https://xturing.stochastic.ai/ c) xTuring: Easily build, customize and…

Paper and discussion history. A mention is not an endorsement.

BloombergGPT: A Large Language Model for Finance — mentioned by RockyMcNuts

Wed, 12 Apr 2023 21:43:55 GMT

not sure what 'mixing LLM models' entails but these are maybe some good starting points - karpathy - https://www.youtube.com/watch?v=kCc8FmEb1nY - https://towardsdatascience.com/beautifully-illustrated-nlp-m... - https://dzone.com/articles/a-deep-dive-into-the-transformer-... - https://peterbloem.nl/blog/transformers - http://nlp.seas.harvard.edu/2018/04/03/attention.html - https://lilianweng.github.io/posts/2023-01-27-the-transforme... - https://blog.quickchat.ai/post/tokens-entropy-question/ - https://dugas.ch/artificial_curiosity/GPT_architecture.html…

Paper and discussion history. A mention is not an endorsement.

BloombergGPT: A Large Language Model for Finance — mentioned by PaulHoule

Thu, 06 Apr 2023 18:00:31 GMT

That's another problem with that article. The gap between API and fine-tuning is much smaller than the gap between fine-tuning and developing a foundation model. I would look at BloombergGPT as an example https://arxiv.org/abs/2303.17564 here you have a company which can make a document collection about the same size as "The Pile", add that to "The Pile" and train a model based on that. They're not just a big company but they are in the information business so it is clear that it's worth it to them.

Paper and discussion history. A mention is not an endorsement.

BloombergGPT: A Large Language Model for Finance — mentioned by senthil_rajasek

Mon, 03 Apr 2023 22:44:58 GMT

Overall a good article. I learned that the financial news company Bloomberg has built a ChatGPT called BloombergGPT trained on a corpus of 700 billion tokens. Here is the actual research paper from , https://arxiv.org/pdf/2303.17564.pdf I can't tell if this is Bloomberg's attempt at solving a problem or if they are doing this out of FOMO.

Paper and discussion history. A mention is not an endorsement.

BloombergGPT: A Large Language Model for Finance — mentioned by rozim

Sun, 02 Apr 2023 17:08:21 GMT

Data moats? Data not on the web, both for the first pass of training [1], and for fine tuning / RLHF [2]. Maybe compute would be a moat...can you run it in inference cheaper? Conditional computation, very quantized models. Probably training compute is not a moat however. Not sure what SOTA is on callouts to oracles (e.g. calling out to Mathematica or some database) during inference, but maybe if you could use. I would look at BloombergGPT for inspiration on a SOTA vertical GPT [3]. Probably speed to deployment & integration & sales would be a moat too, as once you have customers using your…

Paper and discussion history. A mention is not an endorsement.

BloombergGPT: A Large Language Model for Finance — mentioned by stephanerangaya

Sat, 01 Apr 2023 02:05:59 GMT

Sometimes, they release them the day before but you're right here. They actually link the published paper in the article and I missed it: https://arxiv.org/abs/2303.17564

Paper and discussion history. A mention is not an endorsement.

BloombergGPT: A Large Language Model for Finance — HN submission

Fri, 31 Mar 2023 01:09:06 GMT

BloombergGPT: A Large Language Model for Finance

175 points; 47 discussion replies on HN. Paper and source history. A submission is not an endorsement.