基于器官造型的植物精细重建

项目来源

国家自然科学基金(NSFC)

项目主持人

陆玲

项目受资助机构

东华理工大学

项目编号

61761003

立项年度

2017

立项时间

未公开

项目级别

国家级

研究期限

未知 / 未知

受资助金额

37.00万元

学科

信息科学-电子学与信息系统-信息获取与处理

学科代码

F-F01-F0113

基金类别

地区科学基金项目

关键词

器官造型 ; 结构提取 ; 精细重建 ; 点云 ; 变形

参与者

郭建伟;李丽华;鲍冠伯;程志梅;全卫泽;耿兴晓;王逸群;姚玲洁;张宇阳

参与机构

中国科学院自动化研究所

项目标书摘要:植物器官的精细重建对植物的无损和精确测量,有较大的应用价值和学术价值,需要应用计算机视觉和计算机图形学科知识和技术。现有的方法大多针对单一的植物器官进行重建,且重建后的植物器官模型几何特征显著性不足,难以达到植物器官精细重建的水平。本项目旨在研究多种植物器官的精细重建方法。首先分析植物器官点云的特征,研究多种手段获取点云数据的统一注册方法,研究点云数据中植物器官的分割方法。其次,构建多尺度植物器官的可视化模型,并与点云数据匹配,融合多种方法预测缺失的点云数据,设计变形方法精确重建植物器官,最后进行快速渲染。项目的创新之处在于将植物器官重建与真实点云数据分析相结合,扫描数据与图像数据相融合,变形与造型相结合,这些技术具有较强的逼真度、准确性和实用性。

Application Abstract: Refine reconstruction of plant organs has great value for plants nondestructive precise measurements,and requires the nowledge and technology such as computer vision and computer graphics,etc.Current methods are mostly for a single plant organ econstruction,and the geometric characteristics are not kept well,which is harmful for the reconstruction of plant organ growth model.This project aims to conduct refine reconstruction on a variety of plant organs.Firstly,the point cloud features of plant organs are analyzed,various registration methods are explored to obtain a unified point cloud data.Then how to segment point clouds into plant organs will be studied.Secondly,multi-scale plant organs models will be constructed and to match the point cloud data.Missing point cloud data will be predicted by integrating various means,and deformation methods will be designed for accurate reconstruction of plant organs.Finally,fast rendering will be implemented.The innovation of the project is combining the plant organs reconstruction with the real point cloud data,combined fusing the.scan data with the image data,and integrating modeling with deformation,in order to obtain strong fidelity,accuracy and usefulness.

项目受资助省

江西省

项目结题报告(全文)

植物器官的精细重建对植物的无损和精确测量,有较大的应用价值和学术价值,项目主要研究植物器官的造型、植物器官的精细重建、植物器官的特征检测与分析、图像与点云数据的基本处理等方面内容。植物器官的造型主要包括树木、叶片、花朵、果实造型;植物器官精细重建主要包括模型与图像相结合、模型与骨架相结合、模型与点云结合进行精细重建。项目的创新之处在于将植物器官重建与真实点云数据分析相结合,点云数据与图像数据相融合,变形与造型相结合。研究成果可服务于精准农林业、虚拟现实与数字娱乐、农林业科研教育等众多领域。本项目在执行过程中出版专著1部,发表论文17篇,其中SCI、EI检索论文10篇,北大中文核心3篇;申请中国发明专利10项,其中已授权4项、通知授权1项、公示5项;获植物造型与重建软件著作权2项;培养硕士生6人。

  • 排序方式:
  • 3
  • /
  • 1.基于PCL三维点云花瓣分割与重建

    • 关键词:
    • 三维点云分割;花瓣分割;PCL;三角化重建;曲率特征;体素化处理
    • 任彪;陆玲
    • 《现代电子技术》
    • 2022年
    • 12期
    • 期刊

    三维点云数据的单木植物器官分割的研究仍处于起步阶段,对于植物器官的精确分割还未形成有效的解决方法,对于单个花朵点云分割出花瓣的研究更是少见。为此,文中提出一种基于PCL库三维点云花瓣分割的研究方法,以单个百合花朵三维点云数

    ...
  • 2.基于变形的植物叶片边缘锯齿模拟

    • 关键词:
    • 植物叶片;真实感;可视化;虚拟植物;几何形状;参数方程;变形函数
    • 马思远;陆玲;任彪
    • 《现代电子技术》
    • 2022年
    • 11期
    • 期刊

    针对叶缘具有锯齿特征的植物叶片进行研究,提出一种基于变形的叶片边缘锯齿的形状模拟方法。根据实际的树叶图像提取叶片的长宽比、圆形度等形状信息,确定基础矩形的参数;将变形函数应用在生成的矩形平面上,模拟矩圆形、椭圆形、卵圆形

    ...
  • 3.基于Light-BotNet的激光点云分类研究

    • 关键词:
    • 点云特征图像;BOTNET;TRANSFORM;CNN;激光点云分类
    • 雷根华;王蕾;张志勇
    • 《电子技术应用》
    • 2022年
    • 6期
    • 期刊

    三维点云在机器人与自动驾驶中都有着普遍的应用,深度学习在二维图像上的研究成果显著,但是如何利用深度学习识别不规则的三维点云,仍然是一个开放性的问题。目前大场景点云自身数据的复杂性,点云扫描距离的变化造成点的分布不均匀,噪

    ...
  • 4.基于Feature-RNet的三维大场景点云分类框架

    • 关键词:
    • 点云特征图像;RNet网络框架;大场景点云分类;Oakland数据集;深度学习
    • 雷根华;王蕾;张志勇
    • 《计算机技术与发展》
    • 2022年
    • 6期
    • 期刊

    随着大场景三维点云应用在越来越多的领域中,近些年对激光点云大场景下的分类研究不断深入,各种分类模型层出不穷,在大场景点云分类任务中表现优异,但是依然存在训练时间长、计算复杂以及分类精度低等问题。针对分类精度低这一问题,提

    ...
  • 5.基于SA-PointNetVLAD的点云分类网络

    • 李肖南;王蕾;程海霞;张志勇
    • 《计算机技术与发展》
    • 2022年
    • 5期
    • 期刊

    三维点云数据包含着丰富的形状和比例信息,如何有效准确地对点云数据进行分类已经成为了目前计算机视觉领域的研究热点。由于点云在非欧氏空间中的不规则稀疏结构,并且现有的基于深度学习的三维点云分类模型中缺乏对各个点的局部信息和

    ...
  • 6.3D stem model construction with geometry consistency using terrestrial laser scanning data

    • 关键词:
    • Seebeck effect;Laser applications;Surveying instruments;3D modeling;Three dimensional computer graphics;Mean square error;Steel beams and girders;Forestry;Accurate calculations;Cross sectional profiles;Geometric structure;Mean absolute percentage error;Model visualization;Parameter retrieval;Root mean square errors;Terrestrial laser scanning
    • You, Lei;Guo, Jianwei;Pang, Yong;Tang, Shouzheng;Song, Xinyu;Zhang, Xiaopeng
    • 《International Journal of Remote Sensing》
    • 2021年
    • 42卷
    • 2期
    • 期刊

    The traditional stem model is inconsistent with the real geometry of the stem. Terrestrial laser scanning (TLS) provides a possibility of constructing a realistic stem model. In this study, we present a 3D stem model, which includes the stem axis curve and stem cross-sectional profile curve, with geometrical consistency and stem parameter retrieval methods using TLS data. The 3D stem axis curve is interpolated based on the geometric central points, which are calculated from stem slices formed by stem cross-sections. From the 3D stem axis curve, the stem shape characteristic is clearly depicted in 3D space. Stem parameters, such as the location of a stem cross-section, stem diameter, height, length, curvature and torsion at any position along the stem, are calculated. The stem cross-sectional profile curve is interpolated based on the stem cross-sectional profile points, which are calculated from stem cross-sectional points by angle simplification. Then, the convex-concave characteristic of the stem cross-section is represented by the stem cross-sectional profile curve, and from this, the integral method for basal area calculation is presented. The presented methods were tested on stem points from different tree species with different shape properties. The feasibility and validity of the 3D stem model was demonstrated by 3D stem model visualization. The root mean square error (RMSE) of the presented stem diameter method was 0.129 cm. Compared with the basal area calculated from the cross-sectional profile curve, the mean absolute percentage error (MAPE) and RMSE values of the traditional method were 8.921% and 49.926 cm2, respectively. The stem parameter retrieval experiment demonstrated the accuracy and practicability of the 3D stem model. Compared with the traditional stem model, the 3D stem model can accurately represent the geometric structure of the stem and provide accurate calculations of stem parameters. It will help improve the applications of TLS in forestry inventories. © 2020 Informa UK Limited, trading as Taylor & Francis Group.

    ...
  • 7.Data-driven floor plan understanding in rural residential buildings via deep recognition

    • 关键词:
    • Floor plan understanding; Rural residence; Neural networks
    • Lu, Zhengda;Wang, Teng;Guo, Jianwei;Meng, Weiliang;Xiao, Jun;Zhang, Wei;Zhang, Xiaopeng
    • 《INFORMATION SCIENCES》
    • 2021年
    • 567卷
    • 期刊

    Automatic understanding of floor plan images is a key component of various applications. Due to the style diversity of rural housing design, the latest learning-based approaches cannot achieve satisfactory recognition results. In this paper, we present a new framework for parsing floor plans of rural residence that combines semantic neural networks with a post processed room segmentation. First, we take case studies from typical residential buildings in China's rural areas and provide a novel image dataset, called RuralHomeData, containing 800 rural residence floor plans with accurate man-made annotations. Based on the dataset, we propose a new deep learning-based recognition framework using a joint neural network to predict the geometric elements and text information on the floor plan simultaneously. Our insight is that walls and openings (doors and windows) are the basic elements corresponding to the room boundary that a closed 1D loop must form a certain room. Then the semantic information (e.g., the room function) of room regions can be obtained through text detection and identification. Furthermore, we use the MIQP algorithm to divide the area containing multiple room type texts into multiple room areas. Finally, the input floor plan can be transformed into a room layout graph with room attributes and adjacent relationships. The proposed algorithm has been tested on both urban and rural datasets, and the experimental results demonstrate our efficiency and robustness compared with the state-of-the-art methods.(c) 2021 Elsevier Inc. All rights reserved.

    ...
  • 8.基于k-means分割和迁移学习的番茄病理识别

    • 关键词:
    • 农作物病虫害;k-means分割;卷积神经网络;迁移学习;VGG16
    • 黎振;陆玲;熊方康
    • 《江苏农业科学》
    • 2021年
    • 12期
    • 期刊

    针对有背景干扰的番茄病理叶片,将k-means分割与迁移学习相结合,提出一种基于k-means分割和迁移学习的方法对番茄病害叶片进行识别。首先对原始图像进行一系列预处理,再将处理后的图像进行k-means分割,得到叶片边缘的最小矩阵图像,之后

    ...
  • 9.Comparison of Numerical Calculation Methods for Stem Diameter Retrieval Using Terrestrial Laser Data

    • 关键词:
    • TLS; stem diameter; stem diameter tape; caliper; cylinder fitting;circle fitting;HEIGHT ESTIMATION; SCANNING TLS; TREE HEIGHT; DBH; EXTRACTION;PARAMETERS
    • You, Lei;Wei, Jie;Liang, Xiaojun;Lou, Minghua;Pang, Yong;Song, Xinyu
    • 《REMOTE SENSING》
    • 2021年
    • 13卷
    • 9期
    • 期刊

    Terrestrial laser scanning (TLS) can be used as a millimeter-level measurement tool for forest inventories. However, the stem diameter retrieval accuracy in sample plot scanning is not yet convincing. The errors in each step of stem diameter retrieval algorithms must be evaluated. In this study, six numerical calculation methods for the numerical calculation step, i.e., cylinder fitting (CYF), circle fitting (CF), convex hull line fitting (CLF), the proposed caliper simulation method (CSM), closure B-spline curve fitting (SP) and closure Bezier curve fitting with global convexity (SPC), were applied to stem diameter retrieval, and the similarities and differences were evaluated. The ovality, completeness and roughness were used to evaluate the stem slice point cloud quality. A total of 165 stem slice point clouds at breast height collected from three Larix kaempferi plots were used. Compared with the field-measured stem diameters at breast height (DBHs), the root mean square errors (RMSEs) of the CYF, CF, CLF, CSM, SP and SPC methods were 0.30 cm, 0.30 cm, 0.51 cm, 0.51 cm, 0.56 cm and 0.54 cm, respectively. Compared with the SPC method results, the RMSE of the CSM results was 0.05 cm. The results illustrated that the CYF and CF methods performed the same, as did the CLF and CSM methods. Most DBHs retrieved by the CYF and CF methods were smaller than the field-measured DBHs, and most DBHs retrieved by the CLF, CSM, SP and SPC methods were larger than the field-measured DBHs. This study demonstrated that the CYF and CF methods perform the best and are the most robust, and the measurements by a diameter tape and a caliper are similar enough for forestry inventories. Evaluating and preprocessing stem slice point clouds is a potential way to improve stem diameter retrieval accuracy.

    ...
  • 10.Single Image Tree Reconstruction via Adversarial Network

    • 关键词:
    • Generative adversarial networks;Forestry;Image reconstruction;Musculoskeletal system;Three dimensional computer graphics;Adversarial networks;High-fidelity;Input image;Procedural modeling;Single images;Time-consuming tasks;Tree modeling;Tree reconstruction
    • Liu, Zhihao;Wu, Kai;Guo, Jianwei;Wang, Yunhai;Deussen, Oliver;Cheng, Zhanglin
    • 《Graphical Models》
    • 2021年
    • 117卷
    • 期刊

    Realistic 3D tree reconstruction is still a tedious and time-consuming task in the graphics community. In this paper, we propose a simple and efficient method for reconstructing 3D tree models with high fidelity from a single image. The key to single image-based tree reconstruction is to recover 3D shape information of trees via a deep neural network learned from a set of synthetic tree models. We adopted a conditional generative adversarial network (cGAN) to infer the 3D silhouette and skeleton of a tree respectively from edges extracted from the image and simple 2D strokes drawn by the user. Based on the predicted 3D silhouette and skeleton, a realistic tree model that inherits the tree shape in the input image can be generated using a procedural modeling technique. Experiments on varieties of tree examples demonstrate the efficiency and effectiveness of the proposed method in reconstructing realistic 3D tree models from a single image.
    © 2021 Elsevier Inc.

    ...
  • 排序方式:
  • 3
  • /