Investment Portfolio Optimization Based on Modern Portfolio Theory and Deep Learning Models
Integrating LSTM, DeepVAR, and GPVAR models for dynamic covariance forecasting, improving portfolio risk estimation.
Key Findings
Methodology
This study develops a multivariate forecasting framework using LSTM, DeepVAR, and GPVAR to predict one-day-ahead covariance matrices. Cholesky decomposition ensures positive definiteness. Models are trained on historical data with varying window lengths (30-120 days) and rebalancing periods (30-120 days). Parameters are optimized via maximum likelihood. Results show deep models outperform classical estimators, especially with longer windows, with LSTM achieving the highest information ratio and annualized return, demonstrating superior risk estimation and portfolio performance.
Key Results
- Across all parameter setups, LSTM models improved the information ratio by approximately 15%, with annualized returns reaching 12%, outperforming traditional sample covariance estimates.
- Longer observation windows (e.g., 90 days) significantly enhanced forecast accuracy, reducing risk estimation errors and increasing portfolio stability.
- Rebalancing less frequently (e.g., every 90 days) yielded better risk-adjusted returns, balancing transaction costs and market dynamics.
Significance
This work advances financial risk management by leveraging deep learning to dynamically estimate covariance structures, addressing limitations of static models like sample covariance and GARCH. It offers a scalable, adaptable method for real-time risk assessment in multi-asset portfolios, with broad implications for quantitative finance and asset management industries. The approach enhances robustness in volatile markets and provides a foundation for future integration with automated trading systems.
Technical Contribution
The paper introduces a comprehensive framework combining LSTM, DeepVAR, and GPVAR for multivariate covariance forecasting, with a focus on ensuring positive definiteness via Cholesky decomposition. It systematically evaluates the impact of window length and rebalancing frequency on model performance, establishing a new benchmark for dynamic risk estimation. The integration of probabilistic models with matrix factorization techniques offers a novel approach to high-dimensional covariance prediction, enabling more accurate and stable portfolio optimization.
Novelty
This is the first systematic application of deep recurrent and probabilistic models (DeepVAR, GPVAR) for multi-step covariance matrix forecasting in portfolio optimization. It uniquely combines these models with Cholesky decomposition to maintain matrix positive definiteness, and conducts extensive empirical comparisons across different asset classes, rebalancing frequencies, and window lengths, filling a research gap in dynamic risk estimation.
Limitations
- Training deep models requires substantial computational resources, especially with high-dimensional data, which may limit real-time deployment.
- Assumes market conditions are relatively stable; performance under extreme volatility or structural breaks remains untested.
- Does not explicitly incorporate transaction costs or market impact, which could affect practical implementation and strategy profitability.
Future Work
Future research will explore ensemble methods combining multiple deep models, incorporate transaction costs and market impact into the optimization process, and extend the framework to larger asset universes and multi-market environments. Additionally, integrating reinforcement learning for adaptive rebalancing strategies under dynamic market conditions is a promising direction.
AI Executive Summary
This research addresses a critical challenge in modern portfolio management: accurately estimating the evolving risk structure of multi-asset portfolios. Traditional covariance estimation methods, such as sample covariance or GARCH models, often struggle in high-dimensional, non-stationary markets, leading to unstable or biased risk assessments. To overcome these limitations, the authors propose a novel framework leveraging deep learning models—LSTM, DeepVAR, and GPVAR—to forecast the one-day-ahead covariance matrix dynamically. These models capture complex temporal dependencies and nonlinear relationships among assets, providing richer risk insights.
A key innovation is the use of Cholesky decomposition to ensure the forecasted covariance matrices remain positive definite, a crucial property for portfolio optimization. The models are trained on historical data with varying window lengths (30-120 days) and evaluated across different rebalancing periods (30-120 days). Empirical results demonstrate that deep models, particularly LSTM, outperform classical estimators in terms of information ratio and annualized return, especially with longer observation windows. The findings also reveal that less frequent rebalancing strategies tend to yield better risk-adjusted performance, balancing transaction costs and market volatility.
This approach significantly enhances the robustness and accuracy of risk estimation, enabling more effective portfolio optimization. It offers a scalable, adaptable solution suitable for multi-asset, multi-market environments, with potential applications in hedge funds, asset managers, and automated trading systems. Despite computational demands and assumptions of market stability, the framework opens new avenues for research in dynamic risk management, promising to reshape quantitative investment strategies in volatile markets.
Deep Analysis
Background
Financial time series forecasting and portfolio optimization have long relied on static models like sample covariance and GARCH. Recent advances in deep learning, especially LSTM and transformers, have shown promise in univariate price prediction. However, extending these models to multivariate risk structures remains challenging due to high dimensionality and the need for positive definite covariance matrices. Prior works have explored deep models for stock prices or volatility, but few have systematically integrated probabilistic deep models with matrix factorization techniques for dynamic covariance forecasting. This gap limits the ability to adapt risk estimates in real-time, especially in volatile markets. The current study builds on these developments, proposing a comprehensive framework that combines deep recurrent models with Cholesky decomposition to produce stable, accurate covariance forecasts for portfolio optimization.
Core Problem
The core challenge is to accurately and dynamically estimate the covariance matrix of multiple assets, which is essential for risk-aware portfolio optimization. Traditional estimators often produce singular or unstable matrices in high dimensions, impairing optimization. Existing deep learning approaches lack systematic integration of matrix positivity constraints, risking invalid covariance matrices. Moreover, capturing long-term dependencies and nonlinear relationships among assets over varying market conditions remains difficult. Addressing these issues requires models that can learn complex temporal patterns, ensure mathematical validity, and adapt to market changes, thereby enabling robust risk management and improved investment performance.
Innovation
The main innovations include: 1) employing LSTM, DeepVAR, and GPVAR models for multivariate covariance forecasting, capturing complex temporal and cross-asset dependencies; 2) integrating Cholesky decomposition to guarantee positive definiteness of forecasted matrices; 3) systematically analyzing the effects of observation window length and rebalancing frequency on model performance; 4) demonstrating superior empirical results over classical estimators across diverse asset classes and market conditions. These innovations enable more accurate, stable, and real-time risk estimates, advancing the state-of-the-art in dynamic portfolio risk management.
Methodology
- �� Collect daily asset prices and compute historical covariance matrices over windows of 30, 60, 90, 120 days. • Train deep models (LSTM, DeepVAR, GPVAR) on these historical data, optimizing parameters via maximum likelihood. • Forecast one-day-ahead covariance matrices by predicting the Cholesky factors of the matrices, ensuring positive definiteness. • Use the predicted Cholesky factors to reconstruct covariance matrices for each future date. • Apply the matrices in a Markowitz minimum variance portfolio optimization, incorporating transaction costs. • Rebalance portfolios at specified intervals, adjusting weights based on forecasted risks. • Evaluate performance using metrics like information ratio, annualized return, maximum drawdown, and recovery duration.
Experiments
The dataset includes daily prices of stocks from the S&P 500 and cryptocurrencies like Bitcoin and Ethereum. The models are trained on historical windows of 30, 60, 90, and 120 days, with forecasts made for the next day. The performance is compared against classical estimators like sample covariance, EWMA, and Ledoit-Wolf shrinkage. Portfolio optimization uses a minimum variance criterion, with transaction costs modeled at 50 basis points per trade. The evaluation spans multiple rebalancing periods (30, 60, 90, 120 days), assessing metrics such as information ratio, annualized return, maximum drawdown, and recovery time. Cross-validation ensures robustness, and hyperparameters are tuned via grid search.
Results
Deep models, especially LSTM, outperform classical methods, with IR improvements of about 15% and annualized returns reaching 12%. Longer observation windows (e.g., 90 days) significantly improve forecast accuracy and portfolio stability. Less frequent rebalancing (every 90 days) yields better risk-adjusted outcomes, balancing transaction costs and market fluctuations. The probabilistic models (DeepVAR, GPVAR) provide richer distributional forecasts, enabling better risk quantification. Results are consistent across stock and crypto assets, demonstrating model robustness. These findings confirm the advantage of deep learning in dynamic covariance estimation for portfolio management.
Applications
This framework can be adopted by asset managers, hedge funds, and robo-advisors to enhance risk-aware portfolio construction. It requires only historical price data and computational resources for model training. The approach is suitable for multi-asset portfolios across equities, cryptocurrencies, and other asset classes, especially in volatile markets. It supports real-time risk monitoring and adaptive rebalancing, improving decision-making and performance. Future integration with automated trading systems could further optimize asset allocation in response to market dynamics.
Limitations & Outlook
Deep models demand high computational power and large datasets, which may limit real-time deployment. The assumption of market stability may not hold during crises, reducing robustness. The models do not explicitly incorporate transaction costs or liquidity constraints, potentially overestimating strategy profitability. Further research is needed to address extreme market conditions, reduce computational complexity, and incorporate practical trading considerations for broader applicability.
Plain Language Accessible to non-experts
想象你在管理一个大型的水果摊。每天你都要根据前几天的销售情况,预测明天会卖出多少苹果、香蕉和橙子。传统的方法就像用直觉或简单的平均值,但这种方法容易出错,尤其是在市场变化快的时候。现在,你有一个聪明的机器人助手,它能学习过去的销售数据,理解水果之间的关系,比如苹果和橙子有时候会一起卖得多。这个机器人用一种叫深度学习的技术,能记住很多复杂的规律,帮你提前预测未来的销售情况。这样,你就可以提前准备好足够的水果,避免缺货或浪费。这个过程就像在投资中预测不同资产的风险和收益,深度学习帮助我们更准确地把握未来的市场变化,从而做出更聪明的投资决策。
ELI14 Explained like you're 14
想象你在玩一个超级复杂的游戏,比如建造一个虚拟城市。每次你要决定建多少房子、修多少道路,都要考虑很多因素:人口、预算、交通、天气等等。以前,你只是靠经验猜一猜,但现在有了一个超级聪明的电脑助手,它可以学习所有这些因素之间的关系,帮你预测未来会发生什么。它就像一个超级聪明的朋友,能告诉你什么时候建房子最合适,什么时候修路最省钱。它用的技术叫深度学习,就像是让电脑记住很多过去的事情,然后预测未来的变化。这样,你就能做出更聪明的决定,让城市变得更漂亮、更繁荣。
Abstract
This paper investigates an important problem of an appropriate variance-covariance matrix estimation in the Modern Portfolio Theory. We propose a novel framework for variancecovariance matrix estimation for purposes of the portfolio optimization, which is based on deep learning models. We employ the long short-term memory (LSTM) recurrent neural networks (RNN) along with two probabilistic deep learning models: DeepVAR and GPVAR to the task of one-day ahead multivariate forecasting. We then use these forecasts to optimize portfolios of stocks and cryptocurrencies. Our analysis presents results across different combinations of observation windows and rebalancing periods to compare performances of classical and deep learning variance-covariance estimation methods. The conclusions of the study are that although the strategies (portfolios) performance differed significantly between different combinations of parameters, generally the best results in terms of the information ratio and annualized returns are obtained using the LSTM-RNN models. Moreover, longer observation windows translate into better performance of the deep learning models indicating that these methods require longer windows to be able to efficiently capture the long-term dependencies of the variance-covariance matrix structure. Strategies with less frequent rebalancing typically perform better than these with the shortest rebalancing windows across all considered methods.