It's complicated.
Assuming there is no CTD switches, then yes, the theoretical modified duration should be unchanged and the DV01 will be lower.
For simplicity, imagine that there is only one bond eligible for delivery into the contract. We'll also ignore all the other complications (e.g., variation margins), then the theoretical futures price is simply the converted forward price of the bond:
$$ f = \frac{\text{Bond forward price}}{\text{Bond conversion factor}}. $$
Recall that the conversion factor is approximately the price of a bond assuming its yield to maturity as of the first delivery date is 6%. If we change this to 4%, then the conversion factor will increase, resulting in a decline in $f$, as well as its dollar sensitivity.
For a numerical example, I took the current TY contract (TYZ2020 as of 10/21/2020) and ran some simulations. The left column below shows the current market pricing; the right column shows the model price and duration metrics if the notional coupon is changed to 4% today.

The next table shows the individual deliverables for TYZ2020, including their current conversion factors as well as the theoretical conversion factors at a 4% notional coupon. Notice that the converted forward DV01s are lower, as expected.

However, it's completely plausible that a lower notional coupon does result in a CTD switch. Right now, because yields are so low and curve is upward sloping, CTDs tend to be the higher coupon, lower duration issues. If yields were to rise (meaningfully from current levels) AND notional coupon is adjusted lower, then it's completely plausible for CTDs to move to longer maturity issues, actually increasing both the duration & DV01 of the contracts.
To see this, I shocked the yield curve by 400 bps. The table below shows the delivery probabilities and converted forward DV01s. As you can see, at a much higher yield level, changing the notional coupon actually causes a significant CTD switch into longer maturity bonds, increasing duration.
