Generally speaking, the camera parameters should be set to meet the eventual operational needs and not to optimize calibration performance. Try to fill the images with corners. It doesn't matter if ...