Water Render times

Started by gradient, January 13, 2007, 06:48:43 PM

Previous topic - Next topic

gradient

@Max....the 25% is just a number I made up....It is not based on any information!

Really, what I am saying is that to produce a print quality(3200X2400) of the same image that took me 70 hrs (for 800X600)...would take 16 times as long...in other words, 1120 hours (or about 47 days!)!!!!
Even IF there was a 25% optimization success...it would still take 840 hours!

Based on the render time benchmark database...even IF a CPU was 3x as fast as my machine....that same render would still take 210 hours!   Keep in mind, my render had NO clouds and NO objects, few shaders....it was technically very simple!

Unless SIGNIFICANT optimization is achieved in future builds of TG2, render times will be unacceptably long for "casual" users....and, I think that may affect registered program purchase decisions.


Dark Fire

Quote from: gradient on January 18, 2007, 03:04:13 PM
Unless SIGNIFICANT optimization is achieved in future builds of TG2, render times will be unacceptably long for "casual" users....and, I think that may affect registered program purchase decisions.
That's where my software comes in. I was a casual user of the old Terragen but I wanted to produce high quality animations, so I wrote software that lets an entire network help out. I have started upgrading the software so that it will work with T2TP - an extreme beta is available on my website. However, the beta is useless at the moment because the T2TP command line is broken. :(

buchvecny

guyz i think u are forgetting that TG2 is meant as Professional tool (thus you are expected to own workstation). Its not the amateur TG1 anymore. I honestly dont know how long does take renders with vue/houdini, but i dont think there will be some big difference.

Will

I don't know about hudini but VUE6 Infintite is faster but it has been optimised andthere are no overhangs or plantary renders. Also to reiterate what so many others have siad: This is just a tech preview wait till Terragen 2 is released to judge the final product.

Regards,

Will
The world is round... so you have to use spherical projection.

Superza

Quote from: gradient on January 18, 2007, 03:04:13 PM
@Max....the 25% is just a number I made up....It is not based on any information!

Really, what I am saying is that to produce a print quality(3200X2400) of the same image that took me 70 hrs (for 800X600)...would take 16 times as long...in other words, 1120 hours (or about 47 days!)!!!!
Even IF there was a 25% optimization success...it would still take 840 hours!

Based on the render time benchmark database...even IF a CPU was 3x as fast as my machine....that same render would still take 210 hours!   Keep in mind, my render had NO clouds and NO objects, few shaders....it was technically very simple!

Unless SIGNIFICANT optimization is achieved in future builds of TG2, render times will be unacceptably long for "casual" users....and, I think that may affect registered program purchase decisions.


I dont' know Grad, May be there is some strange issue in your render; the fact that takes ages to render the underwater surfaces looks strange, my last in ReRO' with water, was not render the underwater surfaces: i was humbling about some setting similar to  the 0.9 flag "Back face Culling"  in your case.

I was not saying TDG is fast, my last took 57  hours with quality 1 @1600*1000, and i was render  two new renders about 30 and 90 hours repsectively and they are to half render, to that point is damnly slow(especially with two lightsource)!!!!
But for a professional use TGD will have a great scalability.

Take in mind that with a multitrheaded version of tgd, a quad core processor within few months will costs few hundred dollars and could be 6-8 time faster than your actual cpu, and with another similar computer and network rendering could be a theorical 12-16 time faster.
It could be not so bad if the 1000 hours could be 70!
Best Regards MAX


gradient

@Superza, Will, buchvecny, and Dark Fire... I guess what you guys are all saying is confirming my suspicion....that is that in order to produce "print quality" images from TG2 it will require not only the cost outlay for the reg'd version....but also significant hardware $ outlay in order to bring render times within a reasonable limit.
Perhaps buchvecny's words are most telling...."TG2 is meant as Professional tool (thus you are expected to own workstation). Its not the amateur TG1 anymore"

Unfortunately if that is the case,.....As MOST of us don't have render farms, we won't be able to play the TG game anymore.....

It is somewhat sad to think that the "hobby" user....the one that used TG 0.9xx, helped promote the product and, to some degree helped develop TG2 to it's current state...is now being shut out of the game....

Oshyan

Quote from: gradient on January 18, 2007, 03:04:13 PM
Based on the render time benchmark database...even IF a CPU was 3x as fast as my machine....that same render would still take 210 hours!   Keep in mind, my render had NO clouds and NO objects, few shaders....it was technically very simple!

Your render was technically simple *as far as you know*, but from it sounds like in your description earlier in the thread it was actually the land under the water that took much of the time in rendering. The culling of features that will be rendered over will be improved in the future, so that will speed this sort of thing up a lot, but the real question is whether it's truly the water that took so long, or something else in your scene. You have described the detail settings, but they are by far not the only thing to really impact render time. It's clear you have used very extreme displacement for example, which will take a while to render in itself (even without water). If you used an additional Compute Normal/Compute Terrain for some purpose that could help explain such long render times.

It would really help to see the .tgd file to determine whether there is some issue here, a bug, incorrect settings, etc., and I think it's only fair not to assume it's a fundamental TG2 problem without a full review of the settings used. You may send to support@planetside.co.uk if you would like us to take a look and see if there are any notable issues.

As far as hardware upgrades go, I'm afraid you'll just have to accept the reality of this as a necessity for working with any modern application - TG2, Vue 6, etc. Programs are developed to take advantage of the hardware of their day, not yesterday's and only occasionally tomorrow's. The latest games that are released require good hardware for good performance and the same is true for Terragen 2 or any application, particularly a 3D rendering system.

It's unfortunate that you have to work with an older computer (a 2.2Ghz P4 would have been new perhaps 5 years ago, which is quite a while in the computer industry), but the simple fact is that the advanced capabilities of programs like TG2 are not possible to accomplish in reasonable time using older hardware. TG2 is capable of so much more than TG 0.9 - displacement alone is a huge difference - and these capabilities must naturally come with an increase in rendering time. Doing more in the same time would be a rare miracle of coding and I think you can count the number of times this has happened in commercial applications on two hands.

Fortunately I think it's fairly cheap to upgrade to something decent, which would give you a great speed boost. Since TG2 is not multithreaded at present you could get a very cheap, fast single core Athlon 64 (2.4Ghz for perhaps $80, equivalent of a P4 at 3.2+Ghz) - an entire system upgrade would be less than $500, and if you kept your hard drive, case, optical drive, etc. it could be much less. Or you could go dual core and still keep it very cost-effective - $700 or less for a fully new dual core Athlon 64 X2. Yes these are not really small amounts, and I wouldn't recommend you only upgrade for TG2, but if you have a need for better performance overall the price can be justifiable. Many people spend much more than that for computers that hardly do more than email. :D In any case I think it's pretty clear though that any modern program is going to be making greater and greater demands on your aging system and it would be good to upgrade for your overall computing experience, if possible. I hope it's something you can do in the near future.

As far as optimization goes, well it's very difficult to give any specific numbers. I can tell you that there are many areas of optimization, from improved culling (not rendering parts that will be covered up) - which will effect all aspects of scene render time - to improvements in specific areas of the renderer such as reflections and volumetrics. The latter two will of course only affect scenes that have those features - water and 3D clouds, specifically. So the improvements may depend in part on what aspects of TG2 you focus on, or that impact your current render time the most.

Another area of optimization is multithreading, which will probably create the greatest improvements, at least on multi-core/multi-CPU systems. Fortunately multi-core is the way of the future and dual core systems have already surpassed single core for new purchases (even for laptops), and will quickly become the dominant CPU in modern systems (systems newer than 3 years). There are also possibilities in optimizing for SSE/2/3 and other specific CPU features, although I don't expect these to necessarily show large gains. I won't place any kind of official number on any of these optimization paths as there really is no way to know, but I am confident that overall TG2 render time will improve a great deal even in single threaded rendering, and I'm sure my dual core Athlon will really crank out renders once TG2 is multithreaded. Anyone running a dual core or better CPU should see an amazing difference in the final version with mulithreaded rendering.

In regards to professional use, although it's true that most "professionals" have access to more powerful computer hardware, it's also true that they are often much more demanding of low render times than the average hobbyist. A professional would never put up with 69 hours of rendering time for a single frame. Even the 20-30 hours Gradient and others endured under TG 0.9 would usually be unacceptable for professional use. As we are indeed partly catering to the professional market optimization is definitely a great concern for us. In a way you can perhaps thank the professional users for they probably set a higher standard than anyone, and we do need to live up to it if we hope to compete. I think in general you will only benefit from the work done in catering to this market - it will mean faster render times, more power and flexibility, broader interoperability, and better ultimate image quality.

Finally, let me make clear that nobody is being "shut out of the game", certainly not intentionally. We are trying to make a modern, powerful, flexible 3D rendering system with broad appeal. The simple fact is that this is a demanding task for a computer. Any application that even comes close to what TG2 can do is going to be taxing on your system, that's just the way it works. We are doing our best to make TG2 accessible and enjoyable to all, and that includes optimization as well as UI improvements and potential simplification.

It is unfortunate to hear that any of our users feel we may be abandoning them as that is certainly not our intention. I hope you can understand the difficulty here - we want to support those who were used to TG 0.9, both in user interface and performance, but these things present a problem for the improvements that are necessary for TG2 to compete and excel. It simply wasn't possible to make "TG 0.9 with more" or we would have. To get the kind of power needed we had to basically start over, so many things will be different. We are balancing it all as best we can and I do hope you'll stick with it, at least on the sidelines, to see where it takes Planetside and the community. I have a feeling you may ultimately enjoy where we end up. I certainly hope so. :)

- Oshyan

gradient

#52
Thank you for your response Oshyan.
I guess time will tell.....regards optimization successes.
As I indicated to you in our dialogue over at Renderosity, I do have a newer machine.........unfortunately it is still a 1 1/2 year old P4 2.8Ghz HT.  I have not yet installed TG2TP on it yet....I intend to do so to see what differences in speed I can expect....but from looking at the benchmark database, I am not too hopeful that it will help me too much.

Dark Fire

Quote from: gradient on January 18, 2007, 09:22:26 PM
As MOST of us don't have render farms, we won't be able to play the TG game anymore.....
You don't need a render farm. My software can run off a USB device so you can render wherever you go. Most workplaces have computers these days, so you could render while at work.

I am considering creating an internet version of my software, which should solve problems people are now having with limited processing power, but I am currently concerned about security - if you leave your files in a place where anyone can access them and help with rendering, they may be stolen and/or abused. Even if I were to somehow come up with secure methods of transfer and storage of your data, I would have to keep the internet-based code (most likely PHP) private, thus limiting jobs to being hosted on servers I own.

Will

I was just saying that beween the two Terragen and VUE VUE is faster but thats becuase it has been optimized lets not knock Terragen 2 before it is released. But then again I have a Dell XPS because Im an avid gamer so my box is pretty nice.

Regards,

Will
The world is round... so you have to use spherical projection.

3DGuy

Quote from: Dark Fire on January 19, 2007, 01:42:19 PM
Quote from: gradient on January 18, 2007, 09:22:26 PM
As MOST of us don't have render farms, we won't be able to play the TG game anymore.....
You don't need a render farm. My software can run off a USB device so you can render wherever you go. Most workplaces have computers these days, so you could render while at work.

Right, try that at most companies and you get fired on the spot.

Njen

Nahh, you just render in the background :)

Will

Quote from: njen on January 19, 2007, 01:53:33 PM
Nahh, you just render in the background :)

Do you speak from experience? ;)

Regards,

Will
The world is round... so you have to use spherical projection.

3DGuy

Quote from: njen on January 19, 2007, 01:53:33 PM
Nahh, you just render in the background :)
Uhuh, misuse of company property. There's plenty people fired for doing similar stuff with SETI@home or similar programs.

Will

Hes just playing around 3DGuy don't worrie and if he aint well lets just say I hope his boss does no read this fourm.

Regards,

Will
The world is round... so you have to use spherical projection.