Yeah, not surprising on a 32 bit OS - you only have access to 2GB of memory per application (no matter how much physical memory you have). Fortunately settings that high are not particularly necessary, especially for the simplicity of your scene. AA 4-6 should suffice, detail 0.75, and GI 2/3 or so would give great quality and use less memory.
- Oshyan