Coming from Houdini, you don't need to swap any channels, but you need to flip the Z.
Either: Flip the Z value in the Image Map Shader simply by enabling "Multiply RGB" and changing the 3rd value to -1.
Or: Flip the Z value in the Vector Displacement Shader by changing the Z multiplier to -1.