Hmm, that's quite odd. Maybe you should try applying the image to the terrain with a default shader as well to see if the Image map shader treats it differently. Also, you can continue to fool with the diffuse color, although that doesn't seem to be the answer anymore. I have to admit that I'm rather confused about what's causing this. Is there any layer underneath the terrain shader that could be causing it to be lighter?