For some reason Fake Stones merged together, and fed to a surface layer within another surface layer with a base PF/Surface before it causes the FS to loose their displacement.
Oop, I think I figured it out, the base displacement wasn't being computed right and was pushing around the stones. I added a texture coordinates and it seems to work.