Questions tagged [performance-evaluation]
The performance-evaluation tag has no usage guidance.
119
questions
0
votes
0
answers
19
views
PRIIPs Category 3 - MRM and Performance scenarios
I almost worked my way through the CONSOB's PRIIPS workshop workshop and EMSA's PRIIPS flow diagram. Almost. The final missing part for me is the calculation of the standard performance scenarios for ...
3
votes
1
answer
117
views
Is there an encyclopedia of peformance/risk measures for backtests of strategies?
Analysing a backtest of a strategy i.e., a series of returns of a defined period we can consider various metrics such as the Sharpe-ratio or more exotic ones like the Omega-ratio. What I was wondering:...
- 13.6k
0
votes
0
answers
42
views
Brinson Attribution - Overweight Underweight
I am looking to perform a geometric Brinson type attribution that is able to separate out the effects of underweights and overweight's of individual securities and groups individually.
From an ...
- 101
0
votes
0
answers
27
views
Supervised metric including beta?
I am working in a supervised ML framework. I'd like to define one metric to evaluate a strategy. Naturally I was initially enclined towards overall returns or sharpe ratio. I'd like to implement a ...
- 1,217
0
votes
0
answers
82
views
Difference between the two definitions of Ulcer Index
The Ulcer Index (UI) is defined as follows on page 89 of the book "Practical Portfolio Performance Measurement and Attribution, 2E" by Carl Bacon:
$$
UI= \sqrt{\sum_{i=1}^{i=n} \frac{D_{i}^...
- 75
1
vote
1
answer
151
views
Difference between Maximum Drawdown and Largest Individual Drawdown
Bacon in Practical Portfolio Performance Measurement and Attribution distinguishes between the two, specifying that "Maximum drawdown represents the maximum loss an investor can suffer in the ...
- 75
0
votes
1
answer
83
views
Validation set on Walk Forward Analysis
When backtesting a trading strategy using Walk Forward Analysis/Optimization, I see people split each window into training and testing sets.
Suppose you want to select the best combination of MAs for ...
2
votes
2
answers
262
views
Assessing the GARCH model out-of-time
I have fitted two competing GARCH models, one GARCH(1,2) model and another EGARCH(1,1,1) both with t-distributed errors, on the ...
- 281
0
votes
0
answers
94
views
Bootstrap Reality Check - Why does it only assess the best trading strategy?
I wonder why White's BRC only determines whether the best trading strategy is statistically profitable.
What prevents us from comparing the average V of the second best strategy (i.e. square root of ...
1
vote
0
answers
65
views
Forward returns measurment?
Is there a common approach to measure how a forward contract is performing?
Here's what I'm thinking, each day you would price your forward with the next formula.
$$
F_t = S_0 e^{-r_f T}-Ke^{-r T} = (...
- 282
0
votes
3
answers
226
views
compounding component contributions
Say I have a portfolio which contains two components, A & B.
Below are the daily contributions to performance (0.02 equals 2%), where the overall portfolio return is equal to the sum of component ...
- 259
0
votes
0
answers
222
views
Performance Attribution and FX positions
I'm currently reading the book "Mastering Attribution" from Andrew Colin.
He first explains that you can separate the FX returns from the security return if the returns are continous ...
- 165
1
vote
1
answer
243
views
Confidence in Sharpe ratio given performance
Suppose I have a strategy that I believe has a Sharpe ratio of X - not the Sharpe ratio of the backtest (this can be absolutely determined), but the ratio I expect it will actually take on over the ...
0
votes
1
answer
109
views
Out of Sample Results Decay Rapidly With Prediction Window or Embargo
So I am beginning to dabble my toe into quantitative finance and am trying to validate some model results and am having difficulty thinking about what they tell me.
Here's my situation: I'm trying to ...
- 145
1
vote
1
answer
429
views
Understanding out-of-sample performance metrics for Realized Volatility
I fitted several models on a realized volatility process and then proceeded to obtain out-of-sample results. I'm struggling to interpret these results apart from to tell model A seems better than ...
- 452
5
votes
1
answer
2k
views
Information Coefficient (IC) Formulae Differences
I am learning about Fundamental Law of Active Management, and there seems to be two different Information Coefficient (IC) formulae presented.
Though I myself am not a CFA candidate, these appear to ...
- 185
0
votes
0
answers
112
views
What's the best proxy for a stock contribution to the portfolio returns?
I have a table of the weights of stocks in my portfolio for various periods and another with the returns that those stocks had for the same periods.
If I sum the product between the weights and the ...
- 101
0
votes
1
answer
404
views
What is a cumulative return series?
I guess this is pretty easy but I cannot find a definition anywhere. I am trying to reproduce a paper and they say they use a cumulative return series at some point. Does anyone know exactly what this ...
- 23
0
votes
4
answers
2k
views
Multi-Period Contribution
I've read multiple research papers but can't find a good answer as to why multi-period contributions don't add up to the returns of a portfolio. I understand that arithmetic sums miss the compounding ...
- 115
3
votes
0
answers
115
views
Assess forecasting performance of model in presence of bid-ask bounce
I have a forecasting model for 1-minute asset returns $y_t$ derived from trade data. (The assets are not very liquid.) The predictors of the model include the lagged target variable $y_{t-1}$, which ...
- 481
1
vote
0
answers
338
views
DGTW return adjustment
DGTW refers to the 1997 Daniel, Grinblatt, Titman, and Wermers paper available on Wermers' personal website.
The general idea from what I have understood (please correct me if you think I'm wrong!) is ...
- 263
0
votes
0
answers
62
views
Proper way to measure portfolio returns
I have a peculiar trading strategy and I can't seem to be able to find a proper way to measure its performance.
Background:
The strategy consists of buying certain stocks and then selling them in ...
- 101
0
votes
0
answers
30
views
Funds Performance - Size Weighted (Negative Numbers)
I need to calculate the weighted median, average, sd of PE funds' returns. I weighted the sample according to the amount of committed capital of a fund, but I should consider negative products to ...
1
vote
0
answers
32
views
Statistical testing of out-of-time portfolio performance (measured via a custom metric)
I'm testing (out-of-time) my machine learning (ML) based strategy against a strong benchmark. As a performance metric, I'm using a custom rolling metric $M(t)$ which takes into account the portfolio ...
- 171
2
votes
1
answer
75
views
What are the eurozone bond indices? And where can I find them?
I am trying to calculate the performance of a portfolio of fixed-income funds domiciled and operating exclusively in Europe through a multi-factor model. To do this I need historical data of several ...
0
votes
1
answer
266
views
Are there better performance measures for mean-reverting vs trend-following trading strategies?
The Sharpe ratio is often used as measure to assess risk-adjusted returns of trading strategies. However, there are also other measures that can be used to assess risk-adjusted returns like the ...
- 66
0
votes
0
answers
161
views
What is a proper way to evaluate a backtested strategy if its trading asset has a strong trend?
I backtested a strategy that trades bitcoin, but I'm not sure if it's worth doing it because of the recent strong trend of bitcoin. The buy-and-hold has a better return, Sharpe ratio of the strategy ...
- 11
0
votes
0
answers
53
views
Possible survivorship bias
I am quite new to studying finance so apologies if this turns out to be a trivial question. I am writing my first essay where I want to test a value strategy from 2009-2019 by yearly ranking of the ...
- 1
1
vote
1
answer
295
views
Is "Information Coefficient" correlation or rank correlation?
From the textbook, information coefficient (IC) is a measure of the depth of an active manager’s skill. On a more formal basis, IC measures the “correlation” between actual returns and those predicted ...
- 145
0
votes
0
answers
210
views
How is the total return of an alpha strategy being calculated during backtesting?
I am using a quant simulation platform and I have chosen a formulaic alpha to be used. Now the platform is backtesting and displaying the total return of the alpha strategy over 12 years. The trading ...
1
vote
0
answers
98
views
Mathematical proof of out-of-sample disappointment in portfolio performance being a function of a portfolio's variance
The minimum-variance portfolio is considered more optimal than the maximum Sharpe ratio (tangency) portfolio on the grounds that its in-sample performance is less likely to disappoint out-of-sample.
...
- 2,980
0
votes
0
answers
53
views
internal rate of return ((M/X)IRR ?) of a fund
I have the following data for a fund. The contributions come from the LPs (i.e., the investors invest more in the fund, or withdraw money from the fund), MV stands for market value.
The timing is not ...
- 157
0
votes
0
answers
298
views
Modigliani Squared (M2) and negative fund returns
I often see it quoted that the M2 measure offers an advantage over the sharpe, as sharpe is 'difficult to interpret' for negative returns.
eg: https://en.wikipedia.org/wiki/Modigliani_risk-...
- 1
0
votes
0
answers
43
views
Reliable metric to predict out of sample performance of trading strategy
How can one estimate the performance of a trading strategy on out of sample dataset? Yes, the good old model selection problem. Everyone knows sharpe ratio of your in-sample dataset by itself is a ...
- 21
1
vote
2
answers
76
views
Performance measurement
When I regress the excess performance of a portfolio on the MKT Factor using daily data. I get a Beta of 0.95 and an alpha of 0.00011 that I annualize *252 = 2.77%
I know that the annualized return of ...
- 87
3
votes
2
answers
135
views
Is there a performance measure for the entire efficient frontier?
The Sharpe ratio is an example of a performance measure for individual mean-variance efficient portfolios, regardless if they maximize the Sharpe ratio or not. The efficient frontier, however, ...
- 2,980
1
vote
1
answer
2k
views
How to calculate a position's contribution to its portfolio's tracking error?
Say we have assets X (with weight $w_a$) and Y (with weight $w_y$) in a portfolio. X and B returns are correlated: $Cov(R_x, R_y)\neq 0$.
The portfolio's tracking error is: $std(R_p - R_b) = std((w_x*(...
- 157
3
votes
2
answers
428
views
Can alpha be positive if cumulative returns underperform the benchmark?
According to my portfolio analysis program (pyfolio), the alpha of the following strategy is .17 (I am assuming 17%). [Based on pyfolio documentation, alpha here is the "annualized alpha".]
...
- 55
0
votes
0
answers
31
views
How to Compute the Return for a Series of Investments with Payouts?
I am looking for a metric to track the performance of investments in a security over time. I know what I have in mind but I am not sure how to map it onto a known metric. I want to answer the ...
- 101
2
votes
0
answers
161
views
May Calmar ratio be considered to satisfy monotonicity?
We have the following definitions
$\text{Gain-loss ratio} = \frac{E[X^+]}{|E[X^-]|}=\frac{E[X^+]}{-E[X^-]}=\frac{E[X]}{-E[X^-]}+1$;
where $X$ are the returns, $E[X^+]$ is the expected gain, i.e. $E[X|...
- 21
2
votes
2
answers
162
views
Definition of drawdown
Say I am considering the entire time horizon, is max drawdown what I've drawn in blue, or what's in purple?
Likewise, how about the current drawdown for the period in black (in practice, I am asked ...
- 157
1
vote
0
answers
61
views
How do Hedge Funds account for returns from short selling?
I was going over my notes from an Asset Pricing module yesterday and came across something interesting I hadn't thought about in a while. It was how Hedge Funds can over inflate their performance by ...
- 647
1
vote
3
answers
837
views
CAPM and Beta: problem with regression (Beta is too low yet statistically significant?)
I have two time series of daily return calculated as $\frac{Price_{t}}{Price_{t-1}} -1$. One is the daily returns of a portfolio, the other the daily returns of the index (MSCI World). Period is 2020 ...
- 527
2
votes
3
answers
1k
views
Daily to Monthly Performance Attribution - Getting Effects to equal the Excess Return
I am building a performance attribution tool on Python to help us understand the asset allocation, stock selection effects of our fund.
We are using daily price data for each component within the ...
4
votes
1
answer
1k
views
Why use square root of companies market cap in the WLS matrix
When doing a regression based performance attribution I see that people normally use WLS.
So that both our independent and dependent variables are multiplied by our WLS matrix, which is a diagonal ...
- 259
0
votes
0
answers
229
views
What are the best metrics to evaluate an ML algo backtest, other than the nominal returns?
I have designed an algorithm that uses Support Vector Machines to classify the next day's price movement for several prominent cryptocurrencies on a ...
- 647
0
votes
0
answers
192
views
Performance attribution and monthly rebalance: Is a month enough data to calculate Beta and Alpha?
A portfolio is built systematically by calculating scores and rebalanced each month to invest only in the 80 best scores. Scores change frequently and therefore the portfolio changes each month, ...
- 527
0
votes
1
answer
83
views
Highest asset allocation contribution to the fund’s performance
I am preparing for 2020 May FRM II test and will appreciate any explanation for this question:
In terms of asset allocation contribution, why is real estate made the highest asset allocation ...
- 171
1
vote
2
answers
203
views
Outperform the market with a Beta lower than 1, is it possible? [closed]
I have a portfolio which seems to have outperformed the benchmark for the past 2 years however the risk system I use advises that using recent past data (lookback period of 2 years) the Beta to this ...
- 527
0
votes
0
answers
34
views
Practical definition of stock rating scores
I am trying to understand the practical quantitative definitions of the stock scoring system (1-5) that can be commonly found in sell-side analyst predictions. For instance, a score of 3 suggests ...
- 101