The goal of dividing by the bump $\delta$ is to rescale the sensitivity (slope) $s$ to a 100% bump. If $i$ is just a linear cash position with notional $n$, $V(nx)=nx$, and $$s=\frac{V((1+\delta)nx)-V(nx)}{\delta}=nx.$$It's more convenient to scale to 100% than to some other arbitrary bump size like 1% or .1%.
It is precisely the goal of rescaling the sensitivities of cash equity or FX positions to equity price and to exchange rates so the sensitivities would equal to the mark to market. It shows the "rise" in mark to market if the underlying price or rate "runs" 100%. It shows how much you'd lose/gain if a long/short position becomes worthless. For a linear cash position, you could as well just bump by 100%, whereas for non-linear ones, you get more meaningful sensitivities bumping only a little, both up and down, and then rescaling.
For sensitivities to interest rate, first, we measure the sensitivity to the interest rates going up 1 basis point, rather than down; and secondly rescale the sensitivity to an unrealistically large interest rate hike of 100%, ignoring any non-linearity. However, when perturbing very high interest rates, such as Argentine peso, that's been around 60-70% per year lately, the 1 bp bump gets lost in numerical noise, so you may instead prefer to bump by more than 1 bp. Conversely, in some rare cases you may prefer to bump by less than 1bp. It's more art than science:), but remember to divide the mtm change by the same bump size that you actually used.