This is the problem of Marhsall (1992) "Inflation and Asset Returns in a Monetary Economy" and Balvers and Huang (2009) "Money and the C-CAPM"
Suppose an endowment economy where the representative agent maximizes her expeced lifetime utility subject to a budget constraint and given that transaction costs to purchase consumption goods are mitigated by money holdings, that is: $$ V(w_t,m_t,x_t)=\max_{c_t,\mu_t,\{s_t^i\}_{i=1}^{n}}\left(u(c_t)+\delta\mathbb{E}_{t}\left[V(w_{t+1},m_{t+1}, x_{t+1}\right)]\right) \quad (1)$$ $$\text{subject to}\quad w_{t+1}=R_{t+1}\left[w_t-c_t-T(c_t,m_t) + m_t -\mu_t\right] \quad (2)$$ $$ R_{t+1}=\sum_{i=0}^{n}s_t^i R_{t+1}^{i}, \quad \sum_{i=0}^{n}s_t^i=1 \quad\text{and} \quad (3)$$ $$m_{t+1} = (\mu_t + z_{t+1})/\pi_{t+1} \quad (4)$$ where
- $w_t,$ real financial wealth (excluding money holdings)
- $m_t,$ real money holdings
- $x_t,$ set of state variables, exogenous to the consumer-investor, that is sufficient to represent changes in the investment opportunity set
- $c_t,$ current consumption
- $\mu_t$, real money holdings (for use in the upcoming period)
- $\pi_{t+1}=p_{t+1}/p_t$, gross inflation rate
- $z_{t+1} = (M_{t+1} - M_{t})/p_t$, transfer of government revenues from money creation
- $T(c_t,m_t)$ represents the real transaction cost of purchasing the current level of consumption
- so $m_{t+1}$ are the deflated money holdings of the next period
And it also holds for $T(\cdot,\cdot)$ that it is twice differentiable and also:
- $T(c_t,m_t)\geq 0$, $T_{c}(c_t,m_t)> 0$, $T_{m}(c_t,m_t)< 0$
- $T_{cc}(c_t,m_t)\geq 0$, $T_{mm}(c_t,m_t)\geq 0$ and $T_{cm}(c_t,m_t)\leq 0$
I cite the problem above, since it's been years from the last time I have a course in dynamic programming and at the moment I am struggling to solve it.
This is from the appendix of the paper. This is all about the solution of the problem and nothing else