Questions tagged [testing]
The testing tag has no usage guidance.
31
questions
20
votes
1
answer
2k
views
What techniques are used for testing order book implementations?
I am finishing the implementation of a limit order book for modeling NASDAQ. The order book works off of the ITCH feed. My question is what techniques are typically used for testing order books. I am ...
- 1,805
19
votes
3
answers
754
views
Tests that any system must pass to be taken seriously
In an interview from '96 Bill Eckhardt points out that there are tests that any system must pass to be taken seriously.
That is: tests for (1) overfitting, (2) post-dictiveness, (3) maldistribution ...
user2278
14
votes
0
answers
383
views
Here is an approach for measuring Data Snooping; is it new?
I came up with an approach for measuring data snooping, or overfitting. My question is whether this approach was published and expanded-on already, or is it new?
My approach relies on the observation ...
- 300
11
votes
1
answer
3k
views
What are the main market efficiency measures in the stock market?
I'm going to test for the effect of the change in market efficiency on the stock market portfolio, and, I want to know what are the main measures known in the academic literature in order to compare ...
- 2,486
3
votes
1
answer
283
views
Real time stationarity test
I have a trading system based on Machine Learning which is trading 8 symbols intraday. From the results I found out that some
weeks of trading are successful for some symbols, then it usually switches ...
3
votes
1
answer
473
views
Compare events effect on stock prices from different time periods
I’m going to test for the effect corporate credit rating announcements have on stock prices through different economic climates (good times vs. bad times). I want to research whether or not the stock ...
- 33
3
votes
0
answers
208
views
Strategy Testing
Firstly I am a newbie so I will apologise in advance if this is in the wrong forum. My question concerns testing for an equity trading strategy and I would appreciate any comments as to whether my ...
- 31
3
votes
0
answers
85
views
Test for difference in security returns before and after financial regulation
I'm going to study the effect of corporate credit rating changes (Moody's) on stock prices before and after a specific financial regulation. So far i have used an event study where i have divided the ...
- 51
3
votes
1
answer
1k
views
a simpler test for normality given skewness, kurtosis and autocorrelation and size of time series
I typically do a JB (Jarque Bera) test and DW (Durbin Watson) tests for check for normality given skewness, kurtosis and autocorrelation of the data. However this requires a CHI distribution table ...
- 221
2
votes
1
answer
838
views
Local volatility pricer
I am testing a local volatility pricer by comparing its results under two settings:
Pricing a 5yr ATM call option with a flat volatility of $0.194$
Pricing the call option with the typically shaped ...
- 1,471
2
votes
1
answer
420
views
Testing for stationarity in large sample sizes
I keep struggling with testing 9 samples if they are stationary. Each of these samples is a real valued time series with 714.000 values. If I use the KPSS test with the each compleete sample set, the ...
- 21
2
votes
1
answer
841
views
Testing a simple stock market trading hypothesis? [closed]
I have a simple stock market trading hypothesis ...
Something along these lines:
Based on a certain deviation from a stock market index over a 30-day
period, 5 certain stocks tend to drift ...
- 47
2
votes
0
answers
30
views
Testing the CAPM a la Fama & MacBeth: specific trade-off between expected return and risk
Fama & MacBeth (1973) test a two-parameter model of market equilibrium by examining whether its implications hold empirically. They work with the following generalization of the model:
$$
\tilde ...
- 3,136
2
votes
0
answers
548
views
In sample and out of sample in Mean Variance Optimization
Hello to everyone and thanks again for your help, i have find this forum really helpful while working on my final dissertation.
However I'm here again because I have loads of doubts regarding the in-...
- 51
2
votes
0
answers
901
views
Johansen cointegration test interpretation in R
I want to test my time series for cointegration using the Johansen test in R.
I got the following result and so I know now that at least 5 out of 9 of my time series are cointegrated. My question is, ...
- 21
2
votes
0
answers
41
views
Specifying integration level of time series [closed]
Following model was estimated on 200 observations. How to specify the level of integration of $X_t?$ In brackets there are standard errors and p-value of Breusch-Godfrey test is also shown.
$X_t=0,02+...
- 105
2
votes
0
answers
519
views
How to statistically compare the pricing errors of various option pricing models?
I have three different option pricing models, for which I computed the in-sample and out-of-sample pricing errors.
Now I want to test the pricing performance of these three option pricing models ...
- 538
1
vote
1
answer
120
views
Evaluate the significance of the relationship among VIX and the S&P 500
I have the weekly time series of returns for both VIX and S&P 500.
For the VIX I'm looking at 1 week return period (e.g. this is a 5 day return series rolling weekly)
For the S&P 500, ...
- 11
1
vote
1
answer
577
views
Historical Scenario analysis for stress testing
I am doing historical scenario analysis in order to calculate stressed VAR for which I have taken 2007-2008 US crisis. I have two question in this regard:-
1) As we have to take prices for stocks ...
user18663
1
vote
1
answer
154
views
Faster way to backtest/Walkforward
I am currently using Ninja Trader to program and test my strategies and the forward testing in very time intensive. I am thinking of writing my own code in either c++ or c#.
The question I have is ...
- 31
1
vote
1
answer
216
views
Residuals in the Ljung box test
does anybody know what type of residuals is used in the Ljung box test in R?
raw or standardized?
Because basically when I fit a GARCH model using garchFit, the summary() function gives me all the ...
- 121
1
vote
0
answers
56
views
how to test OMS functionality via FIX?
Has anyone done app dev that tests OMS functionality ( FIX ) ?
Do any brokers or other financial entities make test apis available ?
- 131
1
vote
0
answers
35
views
Trading Platform APIs which support editing holdings
I am developing a tool to assist human traders using a trading platform. For testing, I was wondering if anyone was aware of any trading platforms which support editing the holdings of a paper account....
- 111
1
vote
0
answers
412
views
Comparing two models using Wald Test
I would like to use a Wald test to compare two models.
To give a basic example, let:
$Y_{t}=\alpha+{\phi_1x}_{t-1}+{\beta}_{1}x_{t-1}+{\beta}_{2}x_{t-1}+{\beta}_{3}x_{t-1}+\epsilon_t (A)$
$Y_{t}=\...
- 469
1
vote
0
answers
63
views
A priori selection of acceptable backtesting errors (type I and II)
Is it possible to a priori select an acceptable values of type I and II errors in backtesting (f.e. in case of the unconditional coverage test)? Type I error is directly connected to the significance ...
- 229
1
vote
0
answers
53
views
Considerations when programming back testing engine
I am at the beginning of writing a back testing engine and wanted to get some Feed back on considerations I should take into account , design ideas etc.
- 11
1
vote
0
answers
364
views
Generalized method of moments concept in CAPM testing
In the course of my master thesis I’ve come across a paper by Carr and Wu (2009) where the authors evaluate whether returns on variance swaps can be explained by the simple CAPM. (really only market ...
- 11
0
votes
0
answers
40
views
Alpha form of t-test
I have return data on several stocks that is regressed on two models. If I now want to compare if the estimated alpha differences between the two models are different from 0, do I use a unpaired t-...
- 21
0
votes
0
answers
79
views
CAPM test methodology
Setting
If we test the CAPM using Fama-MacBeth regressions we do the following:
First, run cross-sectional regressions to determine the beta loading
$$ R^i_t- r^f_t = a_i +\beta_i (R^M_t- r^f_t) + \...
- 624
0
votes
1
answer
77
views
Determining significant difference between to return series
I want to analyse whether two return series are different. I was told to run the following regression:
...
user15050
0
votes
0
answers
65
views
Compare performance buy-and-hold strategies after stock-split
QUESTION:
How should I analyze the statistical significance of the difference between two buy-and-hold strategies (or the relative performance) when the samples are not independent?
Background:
I ...
user15050