Technically speaking, in the real world there is no such thing as specular. The specularity component of a light is a speed cheat to simply simulate reflections. Since most objects are not perfectly smooth, these surfaces will diffuse the true reflection which reduces any detail that can be noticed from a general standpoint. This generally leads to the illusion of specularity, as no real detail can be perceived in the real world.
The beveled corner of a desk, for example, may look like it has a line of specular on the edge, but it's really reflecting it's surroundings and sending the light into different directions because of the micro bumpiness of the surface.
In the real world common causes of reflective (specular) surfaces are glass, water and oils (and any product that is derived from oil - plastic, varnishes, etc). Pure metals technically do not have a diffuse component, but entirely consist of reflection. Any addition to the metal which degrades this reflective look is what causes the surface to appear less reflective. phenomena such as dust, dirt and rust can detract from metals reflectiveness. Also the smoothness of the surface of metal (like any other surface smoothness) also plays a part in how reflective a surface is perceived.