Can We Trust LLMs in Finance? Lessons from Three Benchmarks on How Models Read, Judge and Act
Invited Talk, FinNLP-2026 Workshop, co-located with EMNLP 2026, Budapest, Hungary
This invited talk asks a simple question: can we trust large language models (LLMs) in finance? LLMs now sound like financial experts, but sounding right is not the same as being right. The talk answers this question through three benchmarks, each testing a different job that LLMs now do in finance: reading, judging and acting. Each benchmark removes one kind of help that standard evaluations quietly give the model.