I've done that successfully a few times and others too,as far as i know.
There can be problems with displacement sometimes,but as far as colors
it seems to work
properly.You just have to make sure that you don't
export a texture with your models,so that there is no mapping going on.
Depending on the modeling application you use,the export settings do
vary though.
It would help to know which modeling app you are using.