The hard edge of the mask is not the problem. If you soften the edge you get a little bit variation, but overall I bet the populations will still follow a very staight line.
Instead, I suggest to simply use a warp shader to add some irregularity to the staight lines. Jonathan, do you know how to do that?
Regards,
Frank