It probably make sense to see the torchlights. What you could do is put actual Light Source instead. It will look much better and should be faster to render as well. Keep a small radius, something like 0.05 and a small max distance, let's say 10 (depends on how big is your scene)
If I remember correctly you can even turn off the light source itself so you won't have at all the bright spot, only its light on the environment.
Cool scene, it reminds me of the Ewok village at the end of Return of the Jedi