基于器官造型的植物精细重建

项目来源

国家自然科学基金(NSFC)

项目主持人

陆玲

项目受资助机构

东华理工大学

立项年度

2017

立项时间

未公开

项目编号

61761003

项目级别

国家级

研究期限

未知 / 未知

受资助金额

37.00万元

学科

信息科学-电子学与信息系统-信息获取与处理

学科代码

F-F01-F0113

基金类别

地区科学基金项目

关键词

器官造型 ; 结构提取 ; 精细重建 ; 点云 ; 变形

参与者

郭建伟;李丽华;鲍冠伯;程志梅;全卫泽;耿兴晓;王逸群;姚玲洁;张宇阳

参与机构

中国科学院自动化研究所

项目标书摘要:植物器官的精细重建对植物的无损和精确测量,有较大的应用价值和学术价值,需要应用计算机视觉和计算机图形学科知识和技术。现有的方法大多针对单一的植物器官进行重建,且重建后的植物器官模型几何特征显著性不足,难以达到植物器官精细重建的水平。本项目旨在研究多种植物器官的精细重建方法。首先分析植物器官点云的特征,研究多种手段获取点云数据的统一注册方法,研究点云数据中植物器官的分割方法。其次,构建多尺度植物器官的可视化模型,并与点云数据匹配,融合多种方法预测缺失的点云数据,设计变形方法精确重建植物器官,最后进行快速渲染。项目的创新之处在于将植物器官重建与真实点云数据分析相结合,扫描数据与图像数据相融合,变形与造型相结合,这些技术具有较强的逼真度、准确性和实用性。

Application Abstract: Refine reconstruction of plant organs has great value for plants nondestructive precise measurements,and requires the nowledge and technology such as computer vision and computer graphics,etc.Current methods are mostly for a single plant organ econstruction,and the geometric characteristics are not kept well,which is harmful for the reconstruction of plant organ growth model.This project aims to conduct refine reconstruction on a variety of plant organs.Firstly,the point cloud features of plant organs are analyzed,various registration methods are explored to obtain a unified point cloud data.Then how to segment point clouds into plant organs will be studied.Secondly,multi-scale plant organs models will be constructed and to match the point cloud data.Missing point cloud data will be predicted by integrating various means,and deformation methods will be designed for accurate reconstruction of plant organs.Finally,fast rendering will be implemented.The innovation of the project is combining the plant organs reconstruction with the real point cloud data,combined fusing the.scan data with the image data,and integrating modeling with deformation,in order to obtain strong fidelity,accuracy and usefulness.

项目受资助省

江西省

项目结题报告(全文)

植物器官的精细重建对植物的无损和精确测量,有较大的应用价值和学术价值,项目主要研究植物器官的造型、植物器官的精细重建、植物器官的特征检测与分析、图像与点云数据的基本处理等方面内容。植物器官的造型主要包括树木、叶片、花朵、果实造型;植物器官精细重建主要包括模型与图像相结合、模型与骨架相结合、模型与点云结合进行精细重建。项目的创新之处在于将植物器官重建与真实点云数据分析相结合,点云数据与图像数据相融合,变形与造型相结合。研究成果可服务于精准农林业、虚拟现实与数字娱乐、农林业科研教育等众多领域。本项目在执行过程中出版专著1部,发表论文17篇,其中SCI、EI检索论文10篇,北大中文核心3篇;申请中国发明专利10项,其中已授权4项、通知授权1项、公示5项;获植物造型与重建软件著作权2项;培养硕士生6人。

  • 排序方式:
  • 1
  • /
  • 1.Efficient Joint Gradient Based Attack against SOR Defense for 3D Point Cloud Classification

    • 关键词:
    • Deep learning;Statistics;Decision boundary;Defense strategy;Hyper-parameter;Linear approximations;Non-differentiable optimization;Objective functions;Outlier removals;State of the art
    • Ma, Chengcheng;Meng, Weiliang;Wu, Baoyuan;Xu, Shibiao;Zhang, Xiaopeng
    • 《28th ACM International Conference on Multimedia, MM 2020》
    • 2020年
    • October 12, 2020 - October 16, 2020
    • Virtual, Online, United states
    • 会议

    Deep learning based classifiers on 3D point cloud data have been shown vulnerable to adversarial examples, while a defense strategy named Statistical Outlier Removal (SOR) is widely adopted to defend adversarial examples successfully, by discarding outlier points in the point cloud. In this paper, we propose a novel white-box attack method, Joint Gradient Based Attack (JGBA), aiming to break the SOR defense. Specifically, we generate adversarial examples by optimizing an objective function containing both the original point cloud and its SOR-processed version, for the purpose of pushing both of them towards the decision boundary of classifier at the same time. Since the SOR defense introduces a non-differentiable optimization problem, we overcome the problem by introducing a linear approximation of the SOR defense and successfully compute the joint gradient. Moreover, we impose constraints on perturbation norm for each component point in the point cloud instead of for the entire object, to further enhance the attack ability against the SOR defense. Our JGBA method can be directly extended to the semi white-box setting, where the values of hyper-parameters in the SOR defense are unknown to the attacker. Extensive experiments validate that our JGBA method achieves the highest performance to break both the SOR defense and the DUP-Net defense (a recently proposed defense which takes SOR as its core procedure), compared with state-of-the-art attacks on four victim classifiers, namely PointNet, PointNet++(SSG), PointNet++(MSG), and DGCNN. © 2020 ACM.

    ...
  • 2.Detailed 3D Face Reconstruction from Single Images Via Self-supervised Attribute Learning

    • 关键词:
    • 3D modeling;Three dimensional computer graphics;3D face reconstruction;3D Morphable model;High-fidelity;Human face model;Recovery scheme;RGB images;Single images
    • Yang, Mingxin;Guo, Jianwei;Ye, Juntao;Zhang, Xiaopeng
    • 《SIGGRAPH Asia 2020 Posters - International Conference on Computer Graphics and Interactive Techniques, SA 2020》
    • 2020年
    • December 4, 2020 - December 13, 2020
    • Virtual, Online, Korea, Republic of
    • 会议

    We present a novel approach to reconstruct high-fidelity geometric human face model from a single RGB image. The main idea is to add details into a coarse 3D Morphable Model (3DMM) based model in a self-supervised way. Our observation is that most of the facial details like wrinkles are driven by expression and intrinsic facial characteristics which here we refer to as the facial attribute. To this end, we propose an expression related details recovery scheme and a facial attribute representation. © 2020 Owner/Author.

    ...
  • 排序方式:
  • 1
  • /