To make @nbbo2's answer more precise, let's assume that we observe various sums $z_{k,h}$ of independent and identically distributed random variables $x_i$ (i.e. returns),
$$
z_{k}\equiv \sum_{i=k-h_k+1}^k x_i
$$
where $h_k$ is the horizon of aggregation. For simplicity, let's aggregate over one, two, three, ... individual daily returns, $x_i$. On a "normal" day, we'd have $h=1$, and on a Monday, we usually have $h=3$.
Assuming normally distributed individual return contributions, and "smallest time fraction" $\Delta$, e.g. $\Delta = 1/255$, we have
$$
x_i\sim N(\mu\Delta,\sigma^2\Delta)\Rightarrow z_k\sim N(\mu\Delta_k,\sigma^2\Delta_k)
$$
where $\Delta_k=\sum_{i=k-h_k+1}^k\Delta=\Delta \times h_k$.
We can now find the maximum-likelihood-estimators. Given $n$ observations $z_1,\ldots,z_n$ and knowledge of all the individual observation windows $\Delta_1,\ldots,\Delta_n$ the log likelihood is
$$
l(z)=-\frac{n}{2}\ln(2\pi)-\frac{n}{2}\ln(\sigma^2)-\frac{n}{2}\sum_k^n\ln(\Delta_k)-\frac{1}{2}\sum_k^n\frac{(z_k-\mu\Delta_k)^2}{\sigma^2\Delta_k}
$$
The maximum likelihood estimators are found as:
$$
\hat{\mu}=\frac{\sum_k z_k}{\sum_k \Delta_k}
$$
and
$$
\hat{\sigma^2}=\sum_k\frac{\left(z_k-\hat{\mu}\Delta_k\right)^2}{n\Delta_k}
$$