作者：张雁鹏1，高建勇1，周志杰2
单位：1. 苏州热工研究院有限公司设备管理部深圳分部，广东深圳 518028；
2. 华能山东石岛湾核电有限公司生产管理部，山东荣成 264312
中图分类号：TP391.41
文献标识码：A
文章编号：1006-883X(2020)05-0013-05
收稿日期：2020-03-15
摘要：在虚拟现实（VR）技术中，为获得更宽的视场需要将多幅图片通过拼接构建出全景。目前大多数基于特征的图像拼接算法采用单应性矩阵变换或保持内容的变形来实现图像对准。基于单应性矩阵变换方法很难处理视差，而保持内容变形方法不能保持图像的结构特性。本文提出了一种精确的单应性矩阵的求解方法，由匹配点和特征点求得全局单应性矩阵，并通过非线性优化方法对该结果进行优化。进一步针对局部变形带来的误差，结合几何和光度约束来设计代价函数，通过最小化该函数获得更好的图像对准结果，从而产生精确的拼接图像。通过各种开放数据集的实验结果表明，本文提出的图像配准方法效果最好。
关键词：虚拟现实；图像拼接；图像匹配；非线性优化
Research on VR Scene Stitching Based on Nonlinear Optimization
ZHANG Yan-peng1, Gao Jian-yong1, ZHOU Zhi-jie2
1. Suzhou Thermal Power Research Institute Co., Ltd., Equipment Management Department, Shenzhen, Guangdong 518028, China; 2. Production Management Department, Huaneng Shandong Shidaowan Nuclear Power Co., Ltd., Rongcheng, Shandong 264312, China
Abstract: In virtual reality (VR), in order to obtain a wider field of view, multiple images need to be stitched to construct a panorama. Despite significant advances in image stitching in recent years, this problem still lacks a reliable solution. Most feature-based image stitching algorithms perform image alignment based on homography matrix transformations or by maintaining distortion of the content. It is difficult to deal with parallax based on the homography matrix transformation method, and the content modification algorithm cannot maintain the structural characteristics of the image. In this paper, an accurate method for solving the homography matrix is proposed. The global homography matrix is obtained from the matching points and the feature points, and the result is optimized by the nonlinear optimization method. Further errors caused by local deformation, combined with geometric and photometric constraints to design our cost function, minimize this function, and obtain better image alignment, resulting in accurate image stitching. Experimental results through various open datasets show that our proposed method is superior to the most advanced image spelling algorithm.
Key words: VR; Image Stitching; image matching; nonlinear optimization
阅读全文
备注：2020年 第26卷 第05期