In stochastic calculus, expressions of the type:
$$
dX_t = a(t, X_t)dt + b(t, X_t) dW_t
$$
are called stochastic differential equations.
What the one above means for example is that $X_t$ has the following expression:
$$
X_t = X_0 + \int_0^t a(u, X_u)du + \int_0^t b(u, X_u) dW_u
$$
The first integral is a regular one, and the second is called a stochastic integral or Ito integral. You can find a rigorous definition of stochastic integrals in any stochastic calculus notebook. It is defined as the limit of a sum over some subdivision when its mesh goes to zero (similar to how the Riemann integral is defined).
See for example:https://en.wikipedia.org/wiki/It%C3%B4_calculus
As for the symbol's definition, I think $\mathbb{E} \left[dX_tdY_t \right]$ denotes the covariation of $X$ and $Y$, which is sometimes denoted $d\langle X, Y\rangle_t$ or $d[X, T]_t$.
This quantity also has a rigorous mathematical definition (also as a sum, resembling that of a covariance, over a partition when the mesh goes to zero). You can think of it as the instantaneous covariance between $X$ and $Y$.
See for example: https://en.wikipedia.org/wiki/Quadratic_variation