The rocks are very good, very realistic. The repeating pastern of the strata shows a little on the right but that is built into the shader and I don't know how to get rid of it either.
One little thing; where is the light inside the cave coming from? I know the atmospheric glow shows the internal structure and gives an impression of depth but without an actual light source inside the cave it should be completely dark in there.