setup a stereo rig
Hello,
I built a stereo camera rig, and I wanted to do triangulation (find X(3d) from xL and xR)
but althought I have good features matches, the fundamental matrix gets sometimes right, sometimes out of whack, no matter what algo I use(ransac, 7pts, 8pts, lmds) if I check xL.t() * F * xR, I get sometimes results close to 0 (barely) sometimes way more than 1
so is it possible that becos of my two cameras are parallel ? should I turn them to some focal point, I though about making it variable, but I would have to recalibrate the rig all the time
the other solution, is to use only one camera and to triangulate from consecutive images (robot moving in 3D space)
any advice is welcome
I can provide the code if needed, but I am pretty sure it is not the issue
Do you use styrofoam to align the cameras? It could be a problem that your cameras move between the different images of your calibration target. It's just a guess but it would be the first thing I'd improve.
nop, it is hard plastic. besides, even if the image content does not change and the camera stay put, I get the same issue, even if the features matches are filtered to be consistents
The hard plastic and a camera looking straight forward is your problem I think. Probably their field of view is so small that the overlapping range is quite limited and thus finding matches is difficult. I guess using a somewhat ellipse shape should improve result ALOT.
actually, I find between 60 and 150 matches, I'll try to add some angle to it
Could you post some of the image pairs?
Hmm weird. 60 matches should do the trick. You sure you have those matches every time?