“BloombergGPT will enable us to tackle many new types of applications, while it delivers much higher performance out-of-the-box than custom models for each application, at a faster time-to-market.” – we see tremendous value in having developed the first LLM focused on the financial domain,” said Shawn Edwards, Bloomberg’s Chief Technology Officer. “For all the reasons generative LLMs are attractive – few-shot learning, text generation, conversational systems, etc. How BloombergGPT performs across two broad categories of NLP tasks: finance-specific and general-purpose. Notably, the BloombergGPT model outperforms existing open models of a similar size on financial tasks by large margins, while still performing on par or better on general NLP benchmarks. The resulting model was validated on existing finance-specific NLP benchmarks, a suite of Bloomberg internal benchmarks, and broad categories of general-purpose NLP tasks from popular benchmarks (e.g., BIG-bench Hard, Knowledge Assessments, Reading Comprehension, and Linguistic Tasks).
Using a portion of this training corpus, the team trained a 50-billion parameter decoder-only causal language model. This data was augmented with a 345 billion token public dataset to create a large training corpus with over 700 billion tokens.
Bloomberg spotify ai archive#
The team pulled from this extensive archive of financial data to create a comprehensive 363 billion token dataset consisting of English financial documents. As a financial data company, Bloomberg’s data analysts have collected and maintained financial language documents over the span of forty years. To achieve this milestone, Bloomberg’s ML Product and Research group collaborated with the firm’s AI Engineering team to construct one of the largest domain-specific datasets yet, drawing on the company’s existing data creation, collection, and curation resources. Bloomberg researchers pioneered a mixed approach that combines both finance data with general-purpose datasets to train a model that achieves best-in-class results on financial benchmarks, while also maintaining competitive performance on general-purpose LLM benchmarks. Today, Bloomberg supports a very large and diverse set of NLP tasks that will benefit from a new finance-aware language model.
Bloomberg spotify ai full#
Furthermore, BloombergGPT will unlock new opportunities for marshalling the vast quantities of data available on the Bloomberg Terminal to better help the firm’s customers, while bringing the full potential of AI to the financial domain.įor more than a decade, Bloomberg has been a trailblazer in its application of AI, Machine Learning, and NLP in finance. This model will assist Bloomberg in improving existing financial NLP tasks, such as sentiment analysis, named entity recognition, news classification, and question answering, among others. BloombergGPT represents the first step in the development and application of this new technology for the financial industry. However, the complexity and unique terminology of the financial domain warrant a domain-specific model. Recent advances in Artificial Intelligence (AI) based on LLMs have already demonstrated exciting new applications for many domains. This large language model (LLM) has been specifically trained on a wide range of financial data to support a diverse set of natural language processing (NLP) tasks within the financial industry. NEW YORK – Bloomberg today released a research paper detailing the development of BloombergGPT TM, a new large-scale generative artificial intelligence (AI) model. BloombergGPT outperforms similarly-sized open models on financial NLP tasks by significant margins - without sacrificing performance on general LLM benchmarks
0 kommentar(er)
