cluster similar keypoints in a set of near similar images

edit

thanks!, that's a beginning for images, that shooted by a tripod. Any ideas how to handle keypoints that are near similar but shooted from a differet position?

For that you would need to use the descriptor matchers and remove any good matches. I'm afraid I don't have enough experience with those methods to help.

yes, that's theI the aproach I'am going. At the moment I compare all images with each other. But it is very difficut to save the intersection from all good matches of all images. Is there a datastructure that can help me to solve this problem?

Well, you can either simply have a list of singular points. First image's points to begin with, then any points with no matches are appended to the list.

Alternatively, you can use the tree structure like in Connected Components. That is designed for holding intersections. You can see that inside the image processing module.