I've seen the same thing. By playing around with this, I have only figured two things -
1. It's necessary to put the last shader into the population.
2. Even with #1 in place, I've seen strange, excessive, extreme or out of kilter displacements cause the objects to settle all over the place.
Hence, I think it's because of the displacements.