面向异形动态目标的视觉伺服轨迹规划与跟踪方法研究

项目来源

国家自然科学基金(NSFC)

项目主持人

沈添天

项目受资助机构

湖南师范大学

项目编号

61803152

立项年度

2018

立项时间

未公开

项目级别

国家级

研究期限

未知 / 未知

受资助金额

25.00万元

学科

信息科学-自动化-机器人学与智能系统

学科代码

F-F03-F0309

基金类别

青年科学基金项目

关键词

基于图像的视觉伺服 ; 特征轨迹 ; 异形目标 ; 规划与跟踪 ; 动态目标 ; 基于图像的视觉伺服 ; 特征轨迹 ; 异形目标 ; 规划与跟踪 ; 动态目标

参与者

李重文;陈中祥;兰浩;苏蓝蓝;李孟谋;胥佐君;李彭健;王舒曼

参与机构

香港大学

项目标书摘要:视觉伺服系统面临工业应用中产品形态多异和产品动态特性复杂多变的问题,亟待实现控制机械臂手眼系统自任意位姿迅速趋近观测中异形动态目标的功能,尚需解决与应用相关的技术瓶颈,包括异形目标特征构建、视觉伺服系统大移位中的多维空间制约问题、面向目标空间运动和形态变化的系统适应问题。本项目拟采用统一相机模型中映射的矩信息构建面向异形目标的优势新特征;采用基于线性矩阵不等式的非线性优化方法解决多维约束下的新特征轨迹规划问题;通过提高多维约束下新特征的轨迹规划和跟踪收敛效率,同时估计动态影响下的特征瞬时变化,据此进行在线轨迹规划、调整校正和跟踪补偿,来解决面向动态目标的系统自适应问题。综上所述,本项目旨在实现面向异形动态目标的视觉伺服系统,达到可远距离快速趋近异形目标的功能,进而达成系统面对异形动态目标的自适应快速趋近,有利于发展视觉伺服控制理论应用于现代工业中,理论创新的同时,具有重要的应用价值。

Application Abstract: Visual Servoing(VS)faces a variety of dynamic products of different shapes and variations in industrial applications.It is imperative to realize the function of controlling an arbitrarily positioned robotic eye-in-hand system to rapidly approach the observed dynamic target in any shape.Application-related technical bottlenecks of VS technology include:feature exploration of targets in various shapes,satisfaction of multidimensional space constraints in large displacement of visual servo system,and system adaptation to targets’motion and shape variations.This project proposes to use moment-based information obtained from projections in the unified camera model to build new advantageous features in VS applications;proposes to use Linear Matrix Inequalities(LMI)based nonlinear optimization methods to solve the new feature trajectory planning problem under multi-dimensional constraints;proposes to solve the system adaptive problems for dynamic targets by improving the trajectory planning and tracking convergence efficiency of new features under multidimensional constraints,and simultaneously estimating the feature instantaneous variations under dynamic influences,and accordingly performing on-line trajectory planning,adjustment and tracking compensation.In summary,this project is aimed at realizing a VS system for dynamic targets in different shapes,achieving a system function that can quickly approach various target shapes from a long distance,and then achieve an adaptive and rapid approach of the system to dynamic targets.This project is beneficial to the development of visual servo technology,and is expected to have not only theoretical innovation,but also important application value in modern industry.

项目受资助省

湖南省

项目结题报告(全文)

项目背景:视觉伺服系统面临工业应用中产品形态多异和产品动态特性复杂多变的问题,亟待实现控制机械臂手眼系统自任意位姿迅速趋近观测中异形动态目标的功能,尚需解决与应用相关的技术瓶颈,包括异形目标特征构建、视觉伺服系统大移位中的多维空间制约问题、面向目标空间运动和形态变化的系统适应问题。本项目提出了基于图像矩的新特征误差及其雅可比矩阵,特征轨迹规划与加速跟踪方法,旨在降低视觉伺服系统对固有特征点的依赖,满足多约束的同时减少趋近步长,提高系统面向异形动态目标的适应性。主要研究内容:为了验证方法的可行性,在三年的研究期间,如申请书所计划的开展了面向异形目标的优势新特征构建,基于非线性优化提出多维约束下的新特征轨迹规划与伺服跟踪加速方法,适用于动态目标的轨迹在线调校与跟踪补偿方法等主要内容的研究。重要结果:1、为规则形状组合目标构建了基于图像矩的视觉伺服控制输入特征向量,推导了特征向量与目标模型参数、成像模型之间的关系;为了减轻系统针对组合目标整体全程可视的约束依赖,设计伺服控制输入特征向量的自适应重组方法,推导与其对应的特征雅可比转换矩阵和在线切换方法;验证了所构建特征及其雅可比矩阵的可行性,针对图像噪声的鲁棒性,尤其是相机大移位情形下的全局收敛性;2、通过建立视觉特征轨迹规划模型,定义跟踪误差,设置轨迹插值,进行多参数优化,紧密跟踪的同时,尽可能地缩减跟踪收敛时长,提升系统面对动态目标的自适应能力;3、在动态环境下,通过在视觉伺服控制器中引入参照视觉特征的校正量和控制器输出的动态补偿量,结合新构建的控制输入特征向量及其雅可比转换矩阵,调整视觉伺服控制器的输出。科学意义:为视觉伺服系统提供面向多形态目标、可满足多个硬件条件制约的控制输入特征轨迹及其转换雅可比,扩展视觉伺服系统的适用目标范围,提升全局收敛效率,为特殊复杂环境下的视觉伺服控制奠定理论和技术基础。

  • 排序方式:
  • 3
  • /
  • 1.基于线性矩阵不等式的智能飞行器航迹规划方法

    • 关键词:
    • 线性矩阵不等式(LMI);航迹规划;水平校正;垂直校正;校正点
    • 沈添天;袁思敏;吴芳;陈中祥;余果
    • 《全球定位系统》
    • 2022年
    • 2期
    • 期刊

    智能飞行器在军用和民用领域发挥着越来越重要的作用.在飞行过程中经常会出现累积的定位误差并且飞行到达应用场景时有定位精度要求,故需要对飞行轨迹进行适当的位置校正.为此,提出了一种在复杂条件下的智能飞行器航迹规划方法,利用基

    ...
  • 2.Improved Dripping Algorithm Based on Modeling the Backflow and Splashing of Water Droplets

    • 关键词:
    • Backpropagation;Consensus algorithm;Drop formation;Motion planning;Problem solving;Back flow;Backflow of water droplet;Dripping algorithm;Droplet flow;Images segmentations;Improved * algorithm;Splashing of water droplet;Water droplets
    • Zhao, Longxu;Shen, Tiantian;Zhang, Qi;Liu, Mengyu;Zuo, Yu;Luo, Mingrui
    • 《43rd Chinese Control Conference, CCC 2024》
    • 2024年
    • July 28, 2024 - July 31, 2024
    • Kunming, China
    • 会议

    The water droplet's dripping path is simulated by dripping algorithms and applied in many fields. In image segmentation, droplets directed by a traditional dripping algorithm may either be trapped in a dead cycle or forced traversing obstacles. To solve this problem, we first propose an improved dripping algorithm based on modeling the backflow of a water droplet. Instead of trapping, the improved algorithm guides the water droplet flow back for dripping opportunities. When blocked by both sides like falling into a low-lying 'shallow pit', we further propose to improve the dripping algorithm based on modeling the splashing of water droplets. This improvement allows water droplets to splash one pixel higher for escaping the 'shallow pit'. Experiments in image segmentation of Guqin music notations validate the proposed method and demonstrate its advantages over traditional dripping algorithms. © 2024 Technical Committee on Control Theory, Chinese Association of Automation.

    ...
  • 3.Visual servoing path-planning for approaching cylindrical objects

    • 关键词:
    • IMAGE MOMENTS; FEATURES
    • Shen, Tiantian;Chesi, Graziano;Hu, Yao;Yang, Jiahong
    • 《JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS》
    • 2023年
    • 360卷
    • 2期
    • 期刊

    Eye-in-hand systems have received significant attention for the task of approaching an object identi-fied by its reference image shown in advance. Image based visual servoing (VS) methods demonstrate robustness to image noises, but encounter difficulties especially when camera displacement is large. More challenges exist when the object is cylindrical with less texture. This paper proposes new feature set and pertinent trajectory planning scheme to achieve a convergent path with tolerable violation of camera field of view (FOV) limits, allowing transient loss of part of the observed object. Specifically, new features and interaction matrices are developed to achieve global convergence. Feature trajectories are then planned with tolerable FOV violation through a constrained nonlinear minimization path-planning technique. They are later tracked via an adapted IBVS controller in a switching manner. Simulation with two views of a real drinking vessel validates the proposed method and demonstrates its adaption to partial FOV violation.(c) 2022 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.

    ...
  • 4.LMI-Based Determination of the Peak of the Response of Structured Polytopic Linear Systems

    • 关键词:
    • Uncertainty; Upper bound; Lyapunov methods; Linear systems; Dynamicalsystems; Time-varying systems; Optimization; Output response; peak;uncertainty; LMI
    • Chesi, Graziano;Shen, Tiantian
    • 《IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS》
    • 2022年
    • 期刊

    This paper addresses the problem of determining the peak of the response to a linear time-invariant (LTI) signal of a linear system whose system matrices are rational functions of an uncertainty vector constrained into a convex bounded polytope. The uncertainty can be time-invariant, bounded-rate time-varying or arbitrarily time-varying. A novel approach based on linear matrix inequalities (LMIs) is proposed for obtaining upper bounds of the sought peak based on the construction of a structured polynomial Lyapunov function in the state and in the uncertainty. A priori and a posteriori conditions for establishing optimality of the obtained upper bounds are also provided. As shown by some numerical examples, which includes the model of an electric circuit, the proposed approach may have significant advantages with respect to the existing methods in terms of conservatism or computational burden.

    ...
  • 5.Why Controlling the Asymptomatic Infection Is Important: A Modelling Study with Stability and Sensitivity Analysis

    • 《FRACTAL AND FRACTIONAL》
    • 2022年
    • 6卷
    • 4期
    • 期刊

    The large proportion of asymptomatic patients is the major cause leading to the COVID-19 pandemic which is still a significant threat to the whole world. A six-dimensional ODE system (SEIAQR epidemical model) is established to study the dynamics of COVID-19 spreading considering infection by exposed, infected, and asymptomatic cases. The basic reproduction number derived from the model is more comprehensive including the contribution from the exposed, infected, and asymptomatic patients. For this more complex six-dimensional ODE system, we investigate the global and local stability of disease-free equilibrium, as well as the endemic equilibrium, whereas most studies overlooked asymptomatic infection or some other virus transmission features. In the sensitivity analysis, the parameters related to the asymptomatic play a significant role not only in the basic reproduction number R-0. It is also found that the asymptomatic infection greatly affected the endemic equilibrium. Either in completely eradicating the disease or achieving a more realistic goal to reduce the COVID-19 cases in an endemic equilibrium, the importance of controlling the asymptomatic infection should be emphasized. The three-dimensional phase diagrams demonstrate the convergence point of the COVID-19 spreading under different initial conditions. In particular, massive infections will occur as shown in the phase diagram quantitatively in the case R-0 > 1. Moreover, two four-dimensional contour maps of R-t are given varying with different parameters, which can offer better intuitive instructions on the control of the pandemic by adjusting policy-related parameters.

    ...
  • 排序方式:
  • 3
  • /