Is there a way to just have specular only in a scene? From my understanding of a few sources specular is much easier to compute than other aspects of reflections, and when it comes to natural formations like rock, at a distance, we could get away with specular only faking wet surfaces where a ray traced reflection isn't needed and only would waste resources.
This would substantially save on render times and for things like leaves, stones, moss/whatever in landscape scenes, would give the same impression to the end-viewers.