In most cases, yes. And underclocking also decreases the voltage. The connection between frequency and voltage is usually controlled by the kernel.
It doesn't do much on Snapdragon phone kernels because those are usually undervolted anyway, but Droid kernels are often heavily overvolted.