1 | initial version |
When you undistort the points, are you supplying the camera matrix in parameter P or leaving it at default? If you leave it at default, then your points will be based on a very different camera matrix. Put your original camera matrix into the undistort function, and of course the distort, but it's required there.
I can't be sure this is your problem, but I've seen it before.