Open-FinLLMs: Open Multimodal Large Language Models for Financial
  Applications
Authors: name: Qianqian Xie, name: Dong Li, name: Mengxi Xiao, name: Zihao Jiang, name: Ruoyu Xiang, name: Xiao Zhang, name: Zhengyu Chen, name: Yueru He, name: Weiguang Han, name: Yuzhe Yang, name: Shunian Chen, name: Yifei Zhang, name: Lihang Shen, name: Daniel Kim, name: Zhiwei Liu, name: Zheheng Luo, name: Yangyang Yu, name: Yupeng Cao, name: Zhiyang Deng, name: Zhiyuan Yao, name: Haohang Li, name: Duanyu Feng, name: Yongfu Dai, name: VijayaSai Somasundaram, name: Peng Lu, name: Yilun Zhao, name: Yitao Long, name: Guojun Xiong, name: Kaleb Smith, name: Honghai Yu, name: Yanzhao Lai, name: Min Peng, name: Jianyun Nie, name: Jordan W. Suchow, name: Xiao-Yang Liu, name: Benyou Wang, name: Alejandro Lopez-Lira, name: Jimin Huang, name: Sophia Ananiadou
Organization: The Fin AI

Large language models (LLMs) have advanced financial applications, yet they
often lack sufficient financial knowledge and struggle with tasks involving
multi-modal inputs like tables and time series data. To address these
limitations, we introduce Open-FinLLMs, a series of Financial LLMs. We
begin with FinLLaMA, pre-trained on a 52 billion token financial corpus,
incorporating text, tables, and time-series data to embed comprehensive
financial knowledge. FinLLaMA is then instruction fine-tuned with 573K
financial instructions, resulting in FinLLaMA-instruct, which enhances task
performance. Finally, we present FinLLaVA, a multimodal LLM trained with 1.43M
image-text instructions to handle complex financial data types. Extensive
evaluations demonstrate FinLLaMA's superior performance over LLaMA3-8B,
LLaMA3.1-8B, and BloombergGPT in both zero-shot and few-shot settings across 19
and 4 datasets, respectively. FinLLaMA-instruct outperforms GPT-4 and other
Financial LLMs on 15 datasets. FinLLaVA excels in understanding tables and
charts across 4 multimodal tasks. Additionally, FinLLaMA achieves impressive
Sharpe Ratios in trading simulations, highlighting its robust financial
application capabilities. We will continually maintain and improve our models
and benchmarks to support ongoing innovation in academia and industry.