So, let me begin with a disclaimer. Elsewhere, I make three mathematical arguments that would impinge on this question in a way you didn't ask, but I feel I should disclose.
The first is that since returns are a ratio of prices times a ratio of quantities plus dividends adjusted for bankruptcy and mergers, returns cannot have a population mean, even if stationary. That would imply that Fama-French cannot be valid. It is non-sensical, mathematically. That is also true for the CAPM it attempts to falsify.
The second is that since Frequentist probabilities are incoherent in the de Finetti sense of the word, any model built on Frequentist axioms will force arbitrage opportunities created by the calculations into existence, defeating an absence of arbitrage assumption.
The third argument is that the calculus the CAPM is built on assumes that all parameters are known and that nobody makes estimates. For some scientific models, the difference between the two is negligible. For finance, the assumption is catastrophic because of a proof in 1958 that models like the CAPM or Fama-French cannot have a solution within the axioms.
Let us assume that none of the above are true. Let us also be concerned with the validity of the CAPM. Let us also assume that we have to make estimates for all parameter values.
The CAPM is built on Frequentist axioms so we will use Frequentist decision theory to test it.
In Frequentist decision theory, we assert a null hypothesis is true and choose a cut-off value for the null such as $p<.05$ or some other value. While I assume you know that, it also impinges on the discussion so I am making that explicit.
The only real prediction in the CAPM is that any intercept will be zero. Unfortunately, for a variety of statistical reasons, that isn't really a testable hypothesis.
Implicitly, however, if all information is contained in $\beta$, then the effect of all other possible factors should be zero, regardless of how you construct them. The null of interest is that $\beta_{SML}=0$ and $\beta_{HML}=0$. If the null is falsified then the CAPM is falsified. So far, we are just inside standard inferential methods, but we are going to wander into decision theory.
If both $\hat{\beta}$ are in the acceptance region, then Frequentist decision theory requires you to behave as if the null is true. In that case, the Capital Asset Pricing Model should be treated as if true. Note that Frequentist decision theory does not assert the truth or falsehood of the null. It says you should behave as if true.
If either $\hat{\beta}$ are in the rejection region, then you are to behave as if the CAPM is false. If you stopped there, then you would have inference the way Ronald Fisher understood it. Falsifying the null has no information in it other than that the null is probably false. Nothing else. Fisher did not have an alternative hypothesis as an idea.
However, because you are controlling the frequencies with the null, setting a cut-off, and presumably controlling for power, you can make a stronger decision. You can decide to reject the null and behave as if the alternative that you specified is true.
Fama and French merely rejected the null. The CAPM is falsified. Nonetheless, the field took the next step and took up the alternative as if true.
Your question has caught on to one of the problems of Fama French. It has no economic reason within mean-variance finance for it to be true. It can create counter-intuitive results because of the independence assumption of the factors in ordinary least squares.
It also has no holiness to its structure. Why create the quantile cuts where they were? The model did not come down from the mountain and was not inscribed in stone? It was made up of choices that were practical. There is no reason to believe it is associated with the data generation function.
The weakness in Frequentist decision theory is that when your alternative lacks a grounding in theory, it is the "as of now" best model, but holds no intrinsic validity.
The difficulty is created by the absence of a binary choice. The Fama-French model is not the only possible way to specify an alternative to the CAPM. If it were, then it would be the one and only alternative and all would be good.
To see a simple example of that, consider a loaded dice that either comes up even 2/5ths, 3/5ths, or 4/5ths of the time. Imagine you made 13 rolls of the dice. If you choose 2/5ths as your null and it is rejected, the maximum likelihood estimator cannot map to either of the alternatives as 5 does not go into 13. The null is rejected at zero as well. Of course, if you observe a zero, the most likely loading is 2/5ths. That loading is excluded as it is rejected.
Null hypothesis methods have problems when you cannot think in terms of a binary choice. There is nothing special about $H_0:\theta=2/5$ as you could have chosen $H_0:\theta=3/5$ or $H_0:\theta=4/5$ as equally valid. Not 2/5ths doesn't allow you to distinguish between the validity of 3/5 or 4/5.
Fama-French was just one of an infinite number of possible alternative constructions.