For some reason when I am using merge by heighest, the heighest areas are just using the Main Inputs colours, and not it's own colours.
Shader preview shows the correct result, but not RTP/Renderer.
Oh god. Figured it out. Selected Base colour with compute terrain and just switched which ones were enabled. Oi.