Let $F_{t,T}$ be the forward price of a stock $S$ at time $T$ and $t$ be the current time. The stock pays a proportional continuous dividend at a rate of $q$ and the risk-free rate is $r$. How can I prove that the price is given by $F_{t,T} = S_{t}e^{(r-q)(T-t)}$, preferably with a no arbitrage argument?
In the no dividend case, I know the derivation can be done with a no arbitrage argument: the forward payoff at $T$ is $S_{T}-F_{t, T}$, so a replicating portfolio consists of one unit of stock with current price $S_t$ and $F_{t, T}e^{-r(T-t)}$ units of cash. Since $F_{t,T}$ is chosen to make the initial value of the forward zero, we have $F_{t,T} = S_te^{rt}$.
In the dividend case, I am not sure what the terminal payoff should be. I feel like we would need to subtract the accumulated value of the dividends, but I am not sure what form it should take in order to get $F_{t,T} = S_{t}e^{(r-q)(T-t)}$. My initial guess was $\text{AV}(\text{div})_{T} = \int_{t}^{T}q S_t dt$, since $qS_tdt$ is the dividend payment per share on $[t, t+dt]$, but this seems wrong as I do not know how to remove the integral.
Note: If possible, I do not want to reference a risk-neutral measure or the Black-Scholes framework. I believe the equation for $F_{t,T}$ should hold as long as there is no arbitrage, but please correct me if I am wrong here.