fix getUndistortRectangles() to ignore corners #27374
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
getUndistortRectangles() generates points along the image border, and uses the mapping of these points to determine the inscribed/circumscribed rectangles. However undistortPoints() is likely to fail in the image corners, and when it fails, it returns the input point. As a result, the inscribed rectangle cannot be greater than the input image size. This means that the result of getOptimalNewCameraMatrix() for alpha=0 has a smaller FOV than ideal.
Below image plots the points along the image border (Source Points) for a 1280x720 image, and the results of undistortPoints() for an AXIS M2035-LE camera.
I have edited getUndistortRectangles() to skip the image corners.
It is preferable to only ignore points where undistortPoints() failed, but that requires quite a bit of refactoring.
Pull Request Readiness Checklist
See details at https://github.com/opencv/opencv/wiki/How_to_contribute#making-a-good-pull-request
Patch to opencv_extra has the same branch name.