0
$\begingroup$

I would like to start with a brief caveat, namely that I am by no means a domain expert in financial markets. Therefore the question I am asking may sound silly to a practitioner but I am asking it since I have not been able to find any satisfying answer online so far.

I have developed a recurrent neural network (RNN) model for time-series forecasting. I now want to test its performance against more standard statistical/econometric models such as ARIMA or VAR. The model outperforms ARIMA in a few of the typical datasets used for model testing (shampoo sales, minimum temperatures...).

However, what I am really interested in is finding out how the model performs on macroeconomic and financial time series (both univariate and multivariate). Here is where the problems start. When I apply the model to macroeconomic indicators (GDP, unemployment...) or stock price indices (opening prices, realized volatility), forecasts appear to be very good at first (high R-squared, low RMSE). However, once I compare them with a baseline random walk model (i.e. y_t=y_t-1), I discover that this always gives the best forecast possible. In other words, both ARIMA and RNN models approximate the random walk forecast but always remain below it (this becomes especially clear after parameter tuning where the best estimates are always selected with a lag never greater than one). This has led me to believe that the series I am considering all more or less exhibit a random walk behaviour.

Therefore, I would like to know if anyone could point me to any financial indicator which has been shown to not exhibit this kind of behaviour (perhaps one with strong seasonal components which can be learned by both ARIMA and RNN models). Ideally this would have daily or monthly observations in order to guarantee as much data as possible, but even quarterly or annually series will do if the time span is long enough.

$\endgroup$
6
  • $\begingroup$ Are you modelling levels or changes? $\endgroup$
    – Bob Jansen
    Nov 5, 2021 at 14:44
  • $\begingroup$ If you want something with strong seasonality, why not just use the NSA rather than the SA data? $\endgroup$
    – user42108
    Nov 5, 2021 at 14:44
  • $\begingroup$ @BobJansen I am more interested in levels but do you think that modelling changes could alleviate the random walk behaviour or would the series still be unpredictable? $\endgroup$ Nov 5, 2021 at 15:15
  • $\begingroup$ @user42108 Good point, I've tried that for macro series but the performance only slightly increases. Is there an equivalent for financial time series? $\endgroup$ Nov 5, 2021 at 15:16
  • 1
    $\begingroup$ No, but by way of example of seasonality in financial time series, there are commodities with strong seasonality in their forward curves (e.g. HO, RB, NG) and there is well-documented intraday seasonality in some products (e.g. volume in equities, realised vol around WMR fix in FX). $\endgroup$
    – user42108
    Nov 5, 2021 at 16:10

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.