基于直线特征约束网格变形的航拍图像拼接
作者:
作者单位:

1.大连理工大学电子信息与电气工程学部;2.大连理工大学工业装备智能控制与优化教育部重点实验室

作者简介:

通讯作者:

中图分类号:

TP273

基金项目:

国家重点研发计划(2016YFC0400903),中央高校基本科研业务费专项资金(DUT20LAB114,DUT2018TB06)


Linear-Preserve-Mesh warps in Aerial Image Stitching
Author:
Affiliation:

1.Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology;2.Key Labrartory of Intelligent Control and Optimization for Industrial Equipment of Ministry of Education, Dalian University of Technology

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对常用航拍图像拼接算法在处理存在视差的复杂图像时会出现鬼影、失真、不自然的问题, 本文在 APAP (As-Projective-As-Possible) 算法的基础上, 添加全局相似性和直线结构保护约束, 提出了一种基于直线特征约束网格变形的航拍图像拼接方法. 首先, 在图像重叠区域检测点、直线特征, 并估计单应性扭曲; 然后, 使用网格将图像划分成多个局部图像块, 建立网格优化模型, 根据网格顶点坐标集定义一个包含图像扭曲不同特征的总能量函数, 在 APAP 算法提供的局部单应性保证重叠区域对齐的前提下, 对非重叠区域借鉴 NISwGSP 算法的全局相似性约束思想, 并辅以直线结构约束提高拼接自然度; 最后, 在稀疏线性系统中求解能量误差最小化问题, 得到最优网格顶点集, 指导网格变形并完成航拍图像拼接. 实验结果表明, 所提变形能够减少重叠区域鬼影和非重叠区域失真问题, 相比 AutoStitch、APAP、AANAP、SPHP 等经典算法拼接效果更自然, 更能适应大视角的航拍图像拼接任务.

    Abstract:

    Aiming at the problems of ghosting, distortion and unnaturalness in processing complex images with large parallax when using common aerial image mosaic algorithm, this paper proposes an aerial image mosaic algorithm based on linear feature constraint mesh deformation. The algorithm adds global similarity and linear structure protection constraints on the basis of APAP (AS-Projective - AS-possible) algorithm. First, detect the features of points and lines to estimate the homography distortion in the overlap region of the image. Then, the image is divided into several local image blocks to establish grid optimization model. According to the grid vertex coordinate set, a total energy function containing different features of image distortion is defined. On the premise that the local homography ensures the alignment of overlap region provided by APAP algorithm, the global similarity constraint of the NISwGSP algorithm as well as the linear structure constraint are used to improve the naturalness of stitching for non-overlapping region. Finally, The optimal grid vertex set can be solved to guide the grid deformation and complete the aerial image mosaic in sparse linear system. The experimental results show that the proposed algorithm can reduce the problems of ghosting and non-overlapping area distortion. Compared with AutoStitch, APAP, AANAP, SPHP and other advanced methods, the proposed algorithm is more natural in stitching effect and is more suitable for the aerial image mosaic task with a certain angle of view.

    参考文献
    相似文献
    引证文献
引用本文
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2020-09-21
  • 最后修改日期:2020-12-21
  • 录用日期:2021-01-08
  • 在线发布日期:
  • 出版日期: