{"id":206263,"date":"2024-05-09T11:08:58","date_gmt":"2024-05-09T15:08:58","guid":{"rendered":"https:\/\/ibkrcampus.com\/?p=206263"},"modified":"2024-05-09T11:08:26","modified_gmt":"2024-05-09T15:08:26","slug":"dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing","status":"publish","type":"post","link":"https:\/\/www.interactivebrokers.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/","title":{"rendered":"Dr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing"},"content":{"rendered":"\n

Dr. Ernest Chan is a noted quantitative hedge fund manager and quant finance author. He has applied his expertise in machine learning in positions with IBM T.J. Watson Research Center\u2019s Human Language Technologies group, Morgan Stanley\u2019s Data Mining and Artificial Intelligence Group, and Credit Suisse\u2019s Horizon Trading Group. He is Founder and Chief Scientist of Predictnow.ai, where his API specs<\/a> can be found, and founder and non-executive chair of QTS Capital Management.<\/p>\n\n\n\n

We asked Dr. Chan about his work in machine learning and AI.<\/strong><\/p>\n\n\n\n

Tell us a little about your career.<\/strong><\/p>\n\n\n\n

I went into machine learning because I was too dumb to be in theoretical physics, for which I got my Ph.D. (when one has some leading figures in the Oppenheimer movie as current or ex-professors in one\u2019s department, one can be forgiven for feeling that way.)<\/p>\n\n\n\n

AI\/ML offered the attraction of scientific research without the burden of having to first learn 400 years of prior knowledge. When I joined IBM\u2019s language modeling group, it was doing some of the cutting-edge research in applying AI research to human languages, stuff that OpenAI and others are doing some 30 years later. A couple of researchers who co-founded our group decided to decamp for a hedge fund just before I arrived, and that piqued my interest in applying AI to investing. (They went on to become co-CEOs of that hedge fund, Renaissance Technologies.) So, after a few very productive years at IBM, I left to join Morgan Stanley\u2019s fledging AI group. Since then, I have always worked at the interface between AI and investing, including at the hedge fund QTS Capital Management and at the AI-driven fintech firm Predictnow.ai, both of which I founded.<\/p>\n\n\n\n

What excites you about machine learning and AI?<\/strong><\/p>\n\n\n\n

As I said, AI\/ML is like scientific research: you often learn something new and unexpected. It is very exciting to find an AI algorithm that actually improves on things people have been working on for decades, such as portfolio optimization.<\/p>\n\n\n\n

What are your current goals?<\/strong><\/p>\n\n\n\n

After the success of the first version of our AI-driven portfolio optimization technology called CPO (\u201cConditional Portfolio Optimization\u201d), we are working on version 2.0, which leverages some of the advances in deep learning that everyone keeps hearing about these days. It is a joy to work with a team of highly motivated and experienced data scientists and machine learners in creating this product. We are also looking for use cases outside of finance.<\/p>\n\n\n\n

What is the focus of Predictnow.ai, including the business model, and how do you deliver value?<\/strong><\/p>\n\n\n\n

After numerous successful proofs of concept, we are now partnering with one of the largest US banks to roll out a fund based on CPO. It is very exciting to see AI helping retail investors avoid risks to their retirement income, which, to me, is one of the most beneficial and humane applications of AI. I am ambivalent about AI taking away creative powers from humans. But to help reduce risks to them and their investments? I am all for it.<\/p>\n\n\n\n

You\u2019ve talked about the power and limitations of machine learning in trading, specifically saying that it helps improve strategy but isn\u2019t yet a viable means of actually managing hedge funds or creating black-box strategies.<\/strong><\/p>\n\n\n\n

Can you give us examples of what machine learning does well, what it doesn\u2019t, and why?<\/strong><\/p>\n\n\n\n

Machine learning is great at finding correlations but not so great at finding causal relationships. In other fields, such as medicine, correlations often lead to causal relations.  Not so in finance. The market is too noisy, too non-stationary, and subject to arbitrage activities, such that machine learning has often found correlations that don\u2019t persist. Hence using it to directly generate enduring alpha has been very hard.  However, using machine learning to find and manage risks and recommend optimal capital allocations is easier. For example, anyone can tell you that when oil prices are high, it\u2019s likely that an oil industry ETF will do well. But it\u2019s not so easy to devise a systematic trading strategy that can profitably trade such an ETF with precise timing using machine learning. Financial machine learning tends to excel at things that do not require high predictive accuracy or exquisite timing. <\/p>\n\n\n\n

Do you think that at some point, machine learning will become smart enough to manage funds without much human intervention?<\/strong><\/p>\n\n\n\n

For sure. At Predictnow, we are exploring how to use generative AI to conduct discretionary trading. Our work is showing promising results that I will describe in my next book, co-authored with a GenAI expert.<\/p>\n\n\n\n

You\u2019ve said you apply machine learning to manage risk for your hedge fund and that it learns from your track record. You\u2019ve also talked about using it for tail hedges. Can you tell us about those uses?<\/strong><\/p>\n\n\n\n

Managing risk via machine learning vs. using a tail hedge strategy as developed by QTS Capital are quite different processes. The former uses machine learning to learn from the historical daily returns of an investment strategy, combines that with big data (which can be viewed as an expanded set of factors familiar to investment professionals), develops a machine learning model, and uses it to compute the probability of loss for that strategy. We call this \u201cCorrective AI\u201d. Tail hedge, on the other hand, is often implemented as a trend-following strategy on an index, or to simply go long on index options. Our trend-following strategy, called Tail Reaper, only trades S&P futures intraday without holding any overnight positions. Just holding positions for a short time during the trading day can already generate great performance in crisis years such as 2020 or 2022 while not constantly bleeding options premiums if one were to long index options.<\/p>\n\n\n\n

Has anything changed in the 18 months since ChatGPT and other generative AI engines became widely available?<\/strong><\/p>\n\n\n\n

Yes. Turning news into sentiment scores used to be very expensive and challenging. With GenAI, we\u2019ve found that to be quite easy.<\/p>\n\n\n\n

The Predictnow.ai website highlights these topics: \u201cApplying Corrective AI to Daily Seasonal Forex Trading\u201d and \u201cConditional Portfolio Optimization (CPO): Using machine learning to adapt capital allocations to market regimes.\u201d Can you tell us something about each?<\/strong><\/p>\n\n\n\n

In the first white paper, we described how Corrective AI can be used to improve an FX strategy\u2019s Sharpe ratio by skipping those days with a high probability of losses as computed by our Machine Learning program. In the second white paper, we described how CPO can improve the Sharpe ratio of portfolios, whether they are portfolios of ETFs or trading strategies, simply by using adaptive capital allocations based on the market environment.<\/p>\n\n\n\n

What kinds of research are you currently working on?<\/strong><\/p>\n\n\n\n

Mainly on version 2.0 of CPO, which leverages some insights gained from the deep learning and reinforcement learning literature.<\/p>\n\n\n\n

What do you anticipate will be the next stage of machine learning, and are there limitations to what it will ultimately do, or do you expect the technology to keep growing indefinitely?<\/strong> <\/p>\n\n\n\n

In terms of alpha generation, there is a limit to how much AI can help. When intelligent robots are trading against intelligent robots, the market simply gains in efficiency. However, in terms of risk management, capital allocation, and other use cases outside of finance, there is no limit. Those are not zero-sum games — the pie just keeps getting bigger, or the risks keep getting smaller. Obviously, generative AI will play a part, but so will more general applications of deep reinforcement and, in general, supervised learning. At Predictnow.ai<\/a>, we\u2019re excited to be part of this remarkable endeavor.<\/p>\n","protected":false},"excerpt":{"rendered":"

Machine learning is great at finding correlations but not so great at finding causal relationships. In other fields, such as medicine, correlations often lead to causal relations. Not so in finance. The market is too noisy, too non-stationary, and subject to arbitrage activities, such that machine learning has often found correlations that don\u2019t persist. <\/p>\n","protected":false},"author":1261,"featured_media":206264,"comment_status":"open","ping_status":"closed","sticky":true,"template":"","format":"standard","meta":{"_acf_changed":true,"footnotes":""},"categories":[339,338,341],"tags":[632,851,2105,852],"contributors-categories":[13576],"class_list":{"0":"post-206263","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-data-science","8":"category-ibkr-quant-news","9":"category-quant-development","10":"tag-ai","11":"tag-algo-trading","12":"tag-deep-learning","13":"tag-machine-learning","14":"contributors-categories-interactive-brokers"},"pp_statuses_selecting_workflow":false,"pp_workflow_action":"current","pp_status_selection":"publish","acf":[],"yoast_head":"\nDr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing<\/title>\n<meta name=\"description\" content=\"Machine learning is great at finding correlations but not so great at finding causal relationships. In other fields, such as medicine, correlations...\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.interactivebrokers.com\/campus\/wp-json\/wp\/v2\/posts\/206263\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Dr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing\" \/>\n<meta property=\"og:description\" content=\"Machine learning is great at finding correlations but not so great at finding causal relationships. In other fields, such as medicine, correlations often lead to causal relations. Not so in finance. The market is too noisy, too non-stationary, and subject to arbitrage activities, such that machine learning has often found correlations that don\u2019t persist.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.interactivebrokers.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/\" \/>\n<meta property=\"og:site_name\" content=\"IBKR Campus US\" \/>\n<meta property=\"article:published_time\" content=\"2024-05-09T15:08:58+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/tech-touch-globe.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"563\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Burt Shulman\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Burt Shulman\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\n\t \"@context\": \"https:\\\/\\\/schema.org\",\n\t \"@graph\": [\n\t {\n\t \"@type\": \"NewsArticle\",\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/#article\",\n\t \"isPartOf\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/\"\n\t },\n\t \"author\": {\n\t \"name\": \"Burt Shulman\",\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#\\\/schema\\\/person\\\/a850fa566867c9ffbdedc42c374a5181\"\n\t },\n\t \"headline\": \"Dr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing\",\n\t \"datePublished\": \"2024-05-09T15:08:58+00:00\",\n\t \"mainEntityOfPage\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/\"\n\t },\n\t \"wordCount\": 1295,\n\t \"commentCount\": 0,\n\t \"publisher\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#organization\"\n\t },\n\t \"image\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/#primaryimage\"\n\t },\n\t \"thumbnailUrl\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/tech-touch-globe.jpg\",\n\t \"keywords\": [\n\t \"AI\",\n\t \"Algo Trading\",\n\t \"Deep Learning\",\n\t \"Machine Learning\"\n\t ],\n\t \"articleSection\": [\n\t \"Data Science\",\n\t \"Quant\",\n\t \"Quant Development\"\n\t ],\n\t \"inLanguage\": \"en-US\",\n\t \"potentialAction\": [\n\t {\n\t \"@type\": \"CommentAction\",\n\t \"name\": \"Comment\",\n\t \"target\": [\n\t \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/#respond\"\n\t ]\n\t }\n\t ]\n\t },\n\t {\n\t \"@type\": \"WebPage\",\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/\",\n\t \"url\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/\",\n\t \"name\": \"Dr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing | IBKR Campus US\",\n\t \"isPartOf\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#website\"\n\t },\n\t \"primaryImageOfPage\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/#primaryimage\"\n\t },\n\t \"image\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/#primaryimage\"\n\t },\n\t \"thumbnailUrl\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/tech-touch-globe.jpg\",\n\t \"datePublished\": \"2024-05-09T15:08:58+00:00\",\n\t \"description\": \"Machine learning is great at finding correlations but not so great at finding causal relationships. In other fields, such as medicine, correlations often lead to causal relations. Not so in finance. The market is too noisy, too non-stationary, and subject to arbitrage activities, such that machine learning has often found correlations that don\u2019t persist.\",\n\t \"inLanguage\": \"en-US\",\n\t \"potentialAction\": [\n\t {\n\t \"@type\": \"ReadAction\",\n\t \"target\": [\n\t \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/\"\n\t ]\n\t }\n\t ]\n\t },\n\t {\n\t \"@type\": \"ImageObject\",\n\t \"inLanguage\": \"en-US\",\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/ibkr-quant-news\\\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\\\/#primaryimage\",\n\t \"url\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/tech-touch-globe.jpg\",\n\t \"contentUrl\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/tech-touch-globe.jpg\",\n\t \"width\": 1000,\n\t \"height\": 563,\n\t \"caption\": \"Quant\"\n\t },\n\t {\n\t \"@type\": \"WebSite\",\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#website\",\n\t \"url\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/\",\n\t \"name\": \"IBKR Campus US\",\n\t \"description\": \"Financial Education from Interactive Brokers\",\n\t \"publisher\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#organization\"\n\t },\n\t \"potentialAction\": [\n\t {\n\t \"@type\": \"SearchAction\",\n\t \"target\": {\n\t \"@type\": \"EntryPoint\",\n\t \"urlTemplate\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/?s={search_term_string}\"\n\t },\n\t \"query-input\": {\n\t \"@type\": \"PropertyValueSpecification\",\n\t \"valueRequired\": true,\n\t \"valueName\": \"search_term_string\"\n\t }\n\t }\n\t ],\n\t \"inLanguage\": \"en-US\"\n\t },\n\t {\n\t \"@type\": \"Organization\",\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#organization\",\n\t \"name\": \"Interactive Brokers\",\n\t \"alternateName\": \"IBKR\",\n\t \"url\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/\",\n\t \"logo\": {\n\t \"@type\": \"ImageObject\",\n\t \"inLanguage\": \"en-US\",\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#\\\/schema\\\/logo\\\/image\\\/\",\n\t \"url\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/ibkr-campus-logo.jpg\",\n\t \"contentUrl\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/ibkr-campus-logo.jpg\",\n\t \"width\": 669,\n\t \"height\": 669,\n\t \"caption\": \"Interactive Brokers\"\n\t },\n\t \"image\": {\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#\\\/schema\\\/logo\\\/image\\\/\"\n\t },\n\t \"publishingPrinciples\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/about-ibkr-campus\\\/\",\n\t \"ethicsPolicy\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/cyber-security-notice\\\/\"\n\t },\n\t {\n\t \"@type\": \"Person\",\n\t \"@id\": \"https:\\\/\\\/ibkrcampus.com\\\/campus\\\/#\\\/schema\\\/person\\\/a850fa566867c9ffbdedc42c374a5181\",\n\t \"name\": \"Burt Shulman\",\n\t \"description\": \"Burt Shulman, Contributing Writer at Interactive Brokers (IBKR), has been a writer and creative marketer in financial information and media for more than 35 years. Before joining IBKR he served as Vice President of Marketing for major divisions of Reuters, Standard & Poor\u2019s, Scholastic, and Universal Music Group, and worked as an independent writer, journalist, and creative consultant.\",\n\t \"url\": \"https:\\\/\\\/www.interactivebrokers.com\\\/campus\\\/author\\\/burt1shulman\\\/\"\n\t }\n\t ]\n\t}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Dr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing","description":"Machine learning is great at finding correlations but not so great at finding causal relationships. In other fields, such as medicine, correlations...","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.interactivebrokers.com\/campus\/wp-json\/wp\/v2\/posts\/206263\/","og_locale":"en_US","og_type":"article","og_title":"Dr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing","og_description":"Machine learning is great at finding correlations but not so great at finding causal relationships. In other fields, such as medicine, correlations often lead to causal relations. Not so in finance. The market is too noisy, too non-stationary, and subject to arbitrage activities, such that machine learning has often found correlations that don\u2019t persist.","og_url":"https:\/\/www.interactivebrokers.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/","og_site_name":"IBKR Campus US","article_published_time":"2024-05-09T15:08:58+00:00","og_image":[{"width":1000,"height":563,"url":"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/tech-touch-globe.jpg","type":"image\/jpeg"}],"author":"Burt Shulman","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Burt Shulman","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/#article","isPartOf":{"@id":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/"},"author":{"name":"Burt Shulman","@id":"https:\/\/ibkrcampus.com\/campus\/#\/schema\/person\/a850fa566867c9ffbdedc42c374a5181"},"headline":"Dr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing","datePublished":"2024-05-09T15:08:58+00:00","mainEntityOfPage":{"@id":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/"},"wordCount":1295,"commentCount":0,"publisher":{"@id":"https:\/\/ibkrcampus.com\/campus\/#organization"},"image":{"@id":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/#primaryimage"},"thumbnailUrl":"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/tech-touch-globe.jpg","keywords":["AI","Algo Trading","Deep Learning","Machine Learning"],"articleSection":["Data Science","Quant","Quant Development"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/","url":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/","name":"Dr. Ernest Chan\u2019s Journey: The Promise and Limits of AI and Machine Learning for Investing | IBKR Campus US","isPartOf":{"@id":"https:\/\/ibkrcampus.com\/campus\/#website"},"primaryImageOfPage":{"@id":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/#primaryimage"},"image":{"@id":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/#primaryimage"},"thumbnailUrl":"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/tech-touch-globe.jpg","datePublished":"2024-05-09T15:08:58+00:00","description":"Machine learning is great at finding correlations but not so great at finding causal relationships. In other fields, such as medicine, correlations often lead to causal relations. Not so in finance. The market is too noisy, too non-stationary, and subject to arbitrage activities, such that machine learning has often found correlations that don\u2019t persist.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ibkrcampus.com\/campus\/ibkr-quant-news\/dr-ernest-chans-journey-the-promise-and-limits-of-ai-and-machine-learning-for-investing\/#primaryimage","url":"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/tech-touch-globe.jpg","contentUrl":"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/tech-touch-globe.jpg","width":1000,"height":563,"caption":"Quant"},{"@type":"WebSite","@id":"https:\/\/ibkrcampus.com\/campus\/#website","url":"https:\/\/ibkrcampus.com\/campus\/","name":"IBKR Campus US","description":"Financial Education from Interactive Brokers","publisher":{"@id":"https:\/\/ibkrcampus.com\/campus\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ibkrcampus.com\/campus\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/ibkrcampus.com\/campus\/#organization","name":"Interactive Brokers","alternateName":"IBKR","url":"https:\/\/ibkrcampus.com\/campus\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ibkrcampus.com\/campus\/#\/schema\/logo\/image\/","url":"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/ibkr-campus-logo.jpg","contentUrl":"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/ibkr-campus-logo.jpg","width":669,"height":669,"caption":"Interactive Brokers"},"image":{"@id":"https:\/\/ibkrcampus.com\/campus\/#\/schema\/logo\/image\/"},"publishingPrinciples":"https:\/\/www.interactivebrokers.com\/campus\/about-ibkr-campus\/","ethicsPolicy":"https:\/\/www.interactivebrokers.com\/campus\/cyber-security-notice\/"},{"@type":"Person","@id":"https:\/\/ibkrcampus.com\/campus\/#\/schema\/person\/a850fa566867c9ffbdedc42c374a5181","name":"Burt Shulman","description":"Burt Shulman, Contributing Writer at Interactive Brokers (IBKR), has been a writer and creative marketer in financial information and media for more than 35 years. Before joining IBKR he served as Vice President of Marketing for major divisions of Reuters, Standard & Poor\u2019s, Scholastic, and Universal Music Group, and worked as an independent writer, journalist, and creative consultant.","url":"https:\/\/www.interactivebrokers.com\/campus\/author\/burt1shulman\/"}]}},"jetpack_featured_media_url":"https:\/\/www.interactivebrokers.com\/campus\/wp-content\/uploads\/sites\/2\/2024\/05\/tech-touch-globe.jpg","_links":{"self":[{"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/posts\/206263","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/users\/1261"}],"replies":[{"embeddable":true,"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/comments?post=206263"}],"version-history":[{"count":0,"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/posts\/206263\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/media\/206264"}],"wp:attachment":[{"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/media?parent=206263"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/categories?post=206263"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/tags?post=206263"},{"taxonomy":"contributors-categories","embeddable":true,"href":"https:\/\/ibkrcampus.com\/campus\/wp-json\/wp\/v2\/contributors-categories?post=206263"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}