As Skiddy said, you won't get a new one with your harness, but most harnesses come with the new wiring to replace the old for the regulator. Your new regulator could come from the local auto parts stores, or maybe even wherever you're getting your harness.
It'll look more like this (
http://www.wildhorses4x4.com/product/Heavy_Duty_Voltage_Regulator/Bronco_Starters) than the one in your pic of course, but functionally it's the same.
But if you're upgrading your alternator to a newer style with an internal regulator, you won't need a new external one at all. So both ways are options.
The dimming lights with lower rpm, and the brightening with higher rpm "can" be the regulator, but it could also be a sign of an old tired or weak alternator, OR based on the looks of your wiring in the pic, some old tired wires and their connections.
Lots of reasons it would do this, but weak output of the alternator at idle is the reason. It's just up to you to find out why it's weak at idle.
Or, just to confuse things further, perhaps the other wires (unrelated to the charging system) are so old and tired, that even a good performing alternator isn't getting the power to the lights!
The new wire harness is going to help a LOT of this other stuff though.
Paul