I do. I don't use normal maps.
You can't really see it, but this is a near vertical wall from a softish (smallest size 1m) basic terrain. I used an old Rome wall to displace and gloss, etc, but left the color (albedo) out. Oh yes and added some lichen.