Questions tagged [machine-learning]

Algorithms that allow computers to evolve behaviors based on empirical data. Approaches include genetic programming, artificial neural networks, decision trees, support vector machines, and cluster analysis.

Filter by
Sorted by
Tagged with
1
vote
0answers
53 views

Machine Learning model forecasting on real time data in python

I’m building a Forex trading system based on machine learning with Python and brokers API. I get price time series data + fundamental data and then i train the model on that. Model means SVM, RF, ...
1
vote
2answers
158 views

Reinforcement learning in finance

In brief, what are some mainstream and recent applications of reinforcement learning in finance that fall outside of the usual scope of agent-based modeling?
1
vote
0answers
40 views

Spectral clustering in finance

What are some examples of applying spectral clustering to financial times series data or other areas of finance? Why spectral clustering was used for each application rather than other types of ...
0
votes
1answer
81 views

How can deep learning methods measure implied volatility?

Why and how should we utilize deep learning methods to calculate implied vol of options? I've also heard that finding the fair price of the option is not nearly as important as finding a numerical ...
2
votes
0answers
55 views

D-Limit and Crumbling Quote Indicator

I've been following the development of the D-Limit order at IEX for some time. In the last couple of days I see the SEC has been sued by Citadel Securities for approving this order type. Can anyone ...
0
votes
0answers
15 views

Models that can improve FHS (with possible residuals manipulation)

The Filtered Historical Simulation (FHS) is a tough benchmark. By: choosing among the most complicated ARMA-GARCH variants with automatic model and lag selection, manipulating standardized residuals ...
3
votes
0answers
69 views

How often to tune the regularisation parameter in LASSO?

I'm trying to implement the following paper: Avellaneda & Lee (2010), Statistical Arbitrage in the US equities market. To build the strategy, the idea is to trade a stock and hedge using a basket ...
0
votes
0answers
85 views

Machine learning algorithms that generate trading models (literature)?

Is there any academic literature on machine learning algorithms that are able to generate functioning trading models? Would this even be feasible at all, now or in the future? Could you point me to ...
1
vote
0answers
40 views

Methods for feature selection in quant finance dataset

I want to perform features selection on my dataset. I've split my data into train, test and out-of-sample set. The dataset is time-series based, so the split is sequenced in the order that train set ...
0
votes
1answer
71 views

Feature engineering for mid-price prediction - quickly changing features

I'm training a fully-connected feed-forward neural network on HFT (limit order book) data to predict the midprice at timepoint $t+\Delta t$ (assuming that $t$ is the current moment, and $\Delta t$ is ...
0
votes
0answers
29 views

Reliable metric to predict out of sample performance of trading strategy

How can one estimate the performance of a trading strategy on out of sample dataset? Yes, the good old model selection problem. Everyone knows sharpe ratio of your in-sample dataset by itself is a ...
0
votes
0answers
44 views

Isn't portfolio optimization basically just feature selection?

Statistical learning has a large assortment of tools for conducting feature selection such as PCA analysis, ridge regression, LASSO, SVM and almost every other machine learning algorithm. In portfolio ...
1
vote
1answer
51 views

How to combine different strategies in a backtest (and IRL)

I am trying to combine long and short strategies into an L/S strategy in my backtesting program. The way I have my backtester set up is it takes a signals object (...
4
votes
0answers
108 views

Machine learning - assigning a value to each tradable moment

I've been looking at machine learning trading strategies for some time and realized recently that I've been neglecting a very important part of the equation in terms of training an effective model. In ...
8
votes
7answers
938 views

Learning and applying Quantitative Finance successfully as an individual instead of a team

In the past few months, I became really interested in using machine learning techniques in the realm of quantitative finance and trading. I made a few rudimentary models and I immediately realized how ...
0
votes
1answer
30 views

In your experience, when trying to predict something that occurs, do you model with a fixed time period?

Let's say you are building a simple model (like the classroom examples) of trying to predict, given past information, if the stock goes up or down in the future. One could, like in classroom examples, ...
-2
votes
2answers
173 views

NLP related finance projects [closed]

fist of all I do apologize if my question is not fit for this forum, but after much research I didn't find a better place to ask this question. I am a PhD student in mathematics. I do know some ML and ...
-3
votes
2answers
128 views

What are important statistical concepts used as a quant?

I'm interviewing for some quantitative researcher positions at some hedge funds, and I've been told that there will be one interview session focused on stats, and one focused on ML, among others. This ...
0
votes
0answers
47 views

Is non-linear correlation problematic in financial time series prediction?

Many traditional finance models assume linear relationships between variables and features. Aren't linear correlations/covariances unable to capture financial processes empirically since they actually ...
1
vote
0answers
82 views

Proof of variance reduction of bagging

In Lecture 4 of the following course: Advances in Financial Machine Learning: 10 Lectures by Marcos Lopez de Prado link in the proof of variance reduction for a ...
1
vote
0answers
55 views

Using unsupervised classification to find support and resistance levels

I do not have a specific question, it's more of a general & conceptual one. What would be the optimal approach to finding support and resistance levels? Have you approached this problem ...
0
votes
0answers
54 views

What is the differential Value-at-Risk?

I am currently working on a Machine Learning Project, implementing portfolio optimization algorithms according to different risk measures. I have found sufficient information on Sharpe Ratio ...
0
votes
1answer
79 views

Unsupervised learning for portfolio construction

Are there techniques or models in finance that (unlike supervised learning where input data such as returns and volatility is estimated making the asset allocation data-driven) allow for portfolio ...
0
votes
0answers
122 views

Optimal predictors for 1-month returns

I am implementing a Random Forest classifier algorithm on Python for predicting future stock returns (one month). My goal is to foresee whether the cumulative returns in a month will be negative or ...
2
votes
0answers
46 views

The discontinuity when applying the combinatorial purged cross-validation

In Marcos Lopez de Prado's book, Advances in financial machine learning, he recommends using the combinatorial purged cross-validation(CPCV) for backtesting. His motivation is sensible. Through the ...
0
votes
1answer
91 views

Which metric is most predictive: Mean, Sharpe, Calmar, …?

Suppose you have created a new trading algorithm: by varying the params of the algorithm, you get a large number of similar trading strategies (e.g. slightly different trigger thresholds, stop loss ...
1
vote
0answers
50 views

Looking for references on reinforcement learning in finance

I plan on using reinforcement learning for a research project. To be specific, I plan to define learning environments using market microstructure models whose solutions are well known and see if I can ...
1
vote
1answer
232 views

LSTM for trend prediction

Been wanting to get my hands dirty with ML for a while now and since I'm interested in finance and trading as well, I figured this would be a good project to get started after reading Deep LSTM with ...
2
votes
3answers
141 views

Dealing with stochastic results of Machine Learning Models

I'm building stock selection models, and pick top 5 and bottom 5 stocks. Given the variability in Stochastic gradient decent results, they keep changing. One way to get consistent results is to use ...
1
vote
0answers
24 views

What is the correct order of operations when cleaning and structuring financial time series?

I'm studying Lopez' Advances in Financial Machine Learning where he talks about how to sample and structure financial data, as well as how to apply machine learning models to the data. I am also ...
5
votes
0answers
73 views

What machine learning algorithms are important for quant interviews? [closed]

I'm not sure if this question is appropriate for this SE board. If not, I can definitely remove it. FWIW, I saw a few other interview-related questions posted on here. Anyways, I will be ...
0
votes
1answer
86 views

How can I combine traditional trading patterns and machine learning algorithms to produce a trading system?

Traditionally, retail traders have leveraged on price patterns discovered by applying graphical tools such as flags, fractals, pennants, heads, shoulders, etc. However, while this method has been ...
2
votes
0answers
50 views

What benefits do using log returns for model training provide?

I came across a paper that uses Support Vector Machines to classify a buy/sell/hold decision each hour at the $\pm$0.5% threshold. The paper can bee seen here. The ...
0
votes
0answers
23 views

Machine-learning (python) non-parametric continuous variables and output

There are various machine-learning techniques available, of which I know there is the (K) NN -> nearest neighbour. However, it seems most non-parametric ML techniques need the input and output to be '...
1
vote
1answer
26 views

Mutual fund rating predictions

I am working on a dataset with aim to predict the MF ratings. There are cols like, 10 yr, 7 yr, 5 yr etc returns. I also have commencement date of MFs, the question is there are MFs with commencements ...
5
votes
2answers
227 views

Forecasting volatility farther ahead with autoregressive machine learning

ARIMA and GARCH are old news for predicting volatility time series of asset returns. I am aware of papers that replace ARIMA and GARCH with machine learning algorithms to predict financial volatility ...
2
votes
1answer
66 views

What's the meaning of linearity in classical statistics in Prado's book?

I am reading Prado's new book, Machine Learning for Asset Managers. In the page1 of his book, there is this sentence. To a greater extent than other mathematical disciplines, statistics is a ...
1
vote
1answer
58 views

How to use multi-periods and mult-factors to predict stock price by linear regression?

Give data in $t_n$ denoted by $[x_1^n, x_2^n, ... x_d^n]$ and label $y_n$ to be predicted. We can just train a $d$-dimensional linear regression $y_n=\sum b_ix_i^n$ to make a prediction. However, I ...
3
votes
0answers
165 views

Meta Labeling for trading opportunities

In Advances in Financial Machine Learning, Lopez explains how we should build a primary exogenous model (binary classifier) to identify trading opportunities and a secondary meta model to filter out ...
4
votes
4answers
198 views

Does the non-causal nature of quant models limit their applicability?

I understand that to describe financial data, we build stochastic models and calibrate their parameters to past data. When coming up with new algorithms, we rely on rigorous backtesting to convince ...
0
votes
1answer
119 views

Random Forest on financial time-serie?

Is it okay to apply Random Forest to a non-stationary financial serie? Or would it be correct to first difference the serie and then apply Random Forest to the new serie?
5
votes
4answers
714 views

Backtest overfitting - in-sample vs out-of-sample

Recently, I read a great paper by De Prado et al. on backtest overfitting problem in Quantitative Finance titled Pseudo-Mathematics and Financial Charlatanism: the Effects of Backtest Overfitting on ...
1
vote
1answer
469 views

How can I approximate Dollar Bars from Minute Data instead of Tick Data?

Having been influenced by de Prado's Advances in Machine learning book, I've set out to build the dollar bars (in which each bar represents a set dollar amount of transactions in the security) that he ...
2
votes
1answer
92 views

Appropriate Encoding for Stock Technical Indicators ? RSI

happy new year and i am new to machine learning + python.. so recently i am doing a project on my own to use machine learning models on technical indicators.. I have my technical indicators data ...
1
vote
3answers
372 views

What's a good resource of book for Python programming in relation to quantitative finance?

I know some of base Python, but I have only briefly used numpy, pandas, etc... I was wondering what's a good resource to learn Python specifically for quantitative finance. I know of plenty of books/...
5
votes
1answer
353 views

How to use neural network for technical analysis?

I am working on building a Neural network for technical analysis of stocks. The input I have is the open price and two (so far) technical indicators : RSI and William's R - for the past 2 years. I can ...
1
vote
1answer
469 views

Why meta-labeling is is robust?

With all due respect, I saw this technique in the book , Advances in financial machine learning, but I found that it acts like a filter for the trades only. And it seems doing the job of overfitting ...
1
vote
0answers
70 views

Using news to predict Stock Prices dataset

In order to build Regression or Deep Learning models for predicting the market, we need a bunch of historical data. Prices and technical indicators are easily accessible, but getting news from the ...
1
vote
0answers
202 views

Machine learning for portfolio optimization

What algorithms from machine learning, supervised learning or unsupervised learning have been recently used for asset allocation models as alternatives to the Markowitz mean-variance optimization ...
2
votes
0answers
63 views

machine-learning method to predict PCA weights

I have been using certain linear-regression to extract the PCA (top 3) weights relating to a certain data-set. I was wondering, instead of using linear-regression to generate the weights, I can use ...