For the stockmarket, this is often a first-pass default assumption. Add in a bit of financial spice, however, and you distribute stock returns lognormally (as opposed to normally), then strictly speaking, they cease to be symmetrical. But 99% of people could not tell the difference 99% of the time.
Turning to debt markets, this rapidly falls apart. 99% of the time, the company does not default and I get my coupon. 1% of the time, they do default and I lose 70-75% of my capital. This is clearly not symmetrical. But this can still represent a random walk!
Think of the random walk as a repetitive coin-flipping exercise. At each step, you flip a coin. But the probability of heads does not have to be 50%; and the relative payoff of heads:tails does not have to be 1:-1. Nothing in the maths of random walks requires symmetry.
Except this is often lazily assumed because it makes the entire subject much easier to think about :-)