If I have a lot of noise in the image, I bump up the atmosphere samples to 128 (max). 96 works well also. Decreasing the haze density may help. I have very rarely had to use more than 1 in the cloud settings. 128 atmosphere samples increases the render time, but not too significantly, even on my Pentium 4.