Professor Lars Kotthoff, a researcher specializing in artificial intelligence and machine learning at Scotland\u2019s University of St. Andrews, brings a unique perspective to discussions about AI in finance.<\/p>\n\n\n\n
“My perspective is simple: I have absolutely no background in financial services. If you took a quick look at my stock portfolio you would agree that I have no idea what I’m doing. I got involved with the R\/Finance conference last year because I\u2019ve been part of a development team for machine learning software that can also be used in the financial industry. I personally have absolutely no experience with this whatsoever \u2013 which is why I’m not quitting my day job.”<\/p>\n\n\n\n
Kotthoff’s journey into AI began during his undergraduate years, sparked by a moment of revelation.<\/p>\n\n\n\n
“You sit in class and you listen to the professor, and they’re going on and on. My impression for a lot of what we were talking about was, honestly, this is all trivial. Why are we even talking about it? In a sense I was right. We were talking about things humans do all the time. No big deal, right? “<\/p>\n\n\n\n
The turning point came when theory met practice.<\/p>\n\n\n\n
“I had to do a practical exercise where I had to implement some practices in code \u2013 again, trivial things \u2013 except what immediately became clear was those trivial things were super difficult. Activities that human beings see as trivial, turned out to be really, really hard for an AI system. Today this is changing almost in real time, but back then it was all new territory.”<\/p>\n\n\n\n
The Long Road to Modern AI<\/strong><\/p>\n\n\n\n The technology underlying today’s AI revolution has deeper roots than many people realize.<\/p>\n\n\n\n “Neural networks, the fundamental technology underlying all of what most people now call generative AI, aka large language models (LLMs), actually go back to the 50s and 60s. In fact the first paper about deep neural networks was talking about analog computers. These were not just simple things with an input layer, an output layer, and maybe something in between, but multiple layers and quite sophisticated architectures. Of course, back then it was all conceptual. There was no way to actually do it.”<\/p>\n\n\n\n Progress came in waves, with key breakthroughs in the 2010s.<\/p>\n\n\n\n “Two things came together. On the one hand, we had more data, which mostly came from the internet. On the other, we had GPUs, which had existed since the mid-90s. Back in the day, GPUs were all about gaming. You always felt you needed the latest and greatest from Nvidia. Now, of course, they’re doing very different things. When all this came together, deep neural networks really took off.”<\/p>\n\n\n\n Kotthoff sees this history as a powerful argument for basic research funding.<\/p>\n\n\n\n “Generative AI is a great success story for pie-in-the-sky, ivory tower research that has no immediate application whatsoever, not even something on the horizon. Because somewhere down the line, it might result in something really fantastic and transformational. If back in the 50s, 60s, and 70s, people hadn’t had the opportunity and funding to investigate the foundations, even though they didn’t yet have a way to create anything, none of what we see today would have happened.”<\/p>\n\n\n\n Two Approaches to AI: Statistical vs. Symbolic<\/strong><\/p>\n\n\n\n Kotthoff’s research focuses on symbolic reasoning systems rather than the statistical models that power large language models. He says the distinction matters enormously.<\/p>\n\n\n\n “LLMs hallucinate. They tell us some things that are just completely and obviously wrong. All the time. No one\u2019s really solved that problem. So far, with statistical systems there\u2019s no way to prevent it.”<\/p>\n\n\n\n Symbolic systems work differently.<\/p>\n\n\n\n “Symbolic reasoning systems are much more restricted in what they can do\u2014they don\u2019t generate completely new text, for example. There are safeguards because they’re actually doing reasoning, not just predicting the next thing through pattern matching.”<\/p>\n\n\n\n He uses Sudoku as an illustrative example.<\/p>\n\n\n\n “You have your 9×9 grid, and you have a bunch of numbers. There’s a lot of reasoning you can do. You look at the first row and see there’s a 5 in there, so there can’t be a 5 in any of the other cells. You combine that with reasoning for all the other rules, columns, and so on. In some cases, you might solve the puzzle directly just by reasoning. A human has built these systems\u2014we’ve written the code that has integrated the rules.”<\/p>\n\n\n\n Symbolic approaches have widespread industrial applications.<\/p>\n\n\n\n “One practical application is logistics problems. You have a certain number of trucks, drivers, and parcels that have to be delivered to particular locations. Or chip companies use these for chip design\u2014how do you place your components such that you can connect all of them while minimizing the total amount of wire being used? The state of the art for these types of problems is still symbolic reasoning.”<\/p>\n\n\n\n The key advantage is robustness in responding to change. <\/p>\n\n\n\n “If you have two different problems\u2014maybe you have an additional truck, or a truck is out of order today\u2014the problems might be sufficiently different that with statistical inference, you can’t figure out what to do, or you get completely nonsensical solutions. With symbolic approaches, you can solve the problem from scratch or start from a previous solution and repair it.”<\/p>\n\n\n\n