I want to measure the impact of mandatory disclosure on inducements on fees. I thought about doing a difference-in-differences analysis around the date of the new regulation with mutual funds as the treatment group and ETFs as control group (since they do not pay kickback to advisors).

My problem of course is that that there are a lot of mutual funds that do also not pay inducements but using Thomson Reuters it is not possible to filter them out.

Do you think the research design would still be valid?

  • 1
    $\begingroup$ The regulation I mean is MiFID that was implemented in 2008 in Europe. Unfortunately, European funds do not disclose 12b-1 fees. Therefore I would look at the TER. $\endgroup$ – user9259005 Aug 29 '18 at 18:26

I think you will struggle for the following reason; you are essentially trying to create a statistical test along the lines of:

$H_0$: impact (mean performance) on impacted mutual funds equals the mean performance on control group, i.e. ETFs, vs,

$H_1$: impact (mean performance) on impacted mutual funds is less than (or different to) the mean performance on control group, i.e. ETFs.

The problem is the parameter assumptions and your sample data;

  • The assumption of equivalence between ETFs as control and mutual funds in the first place is open to criticism, and potentially of a larger variance than your underlying parameter of interest.
  • You have a latent variable which is the proportion of mutual funds in your sample data that do not conform to the impacted group, meaning deriving the critical values (p-values) is unknown, even if you can isolate a test.

I believe you know the answer - the unimpacted mutual funds are the best control group and the impacted mutual funds provide the comparative data, which directly solves the above two problems.

Your question boils down to making estimates due to Thomson Reuters limitations whether or not you can still derive statistically significant results. In my opinion, I'm afraid not, especially since the very nature of the research suggests there may or may not be an effect so it is hard to observe. Sorry...

  • $\begingroup$ Thank you for your answer. This is what I expected and was afraid of. It’s just very unfortunate since I spent quite some time on it already. I am afraid I have to start from scratch again... $\endgroup$ – user9259005 Aug 29 '18 at 18:33

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.