智能汽车环境精细感知、深度融合与动态建模方法

项目来源

国家自然科学基金(NSFC)

项目主持人

吴超仲

项目受资助机构

武汉理工大学

立项年度

2017

立项时间

未公开

项目编号

U1764262

项目级别

国家级

研究期限

未知 / 未知

受资助金额

244.00万元

学科

信息科学-自动化-控制系统与应用

学科代码

F-F03-F0302

基金类别

联合基金项目-重点支持项目-中国汽车产业创新发展联合基金

关键词

智能交通 ; 交通状态感知 ; 自动驾驶 ; 车路协同 ; 数据处理 ; Intelligent Transportation Systems ; Cooperative Vehicle Infrastructure System ; Autonomous vehicles ; Data processing ; Traffic state perception

参与者

李必军;胡钊政;朱敦尧;李连营;陈志军;王玉龙;陆波;郑玲;薛杰

参与机构

武汉大学;重庆长安汽车股份有限公司

项目标书摘要:环境感知与建模是智能汽车的核心内容,环境信息能否正确及时的处理、分析直接关系到智能车辆运行的安全和效率,对路径规划和车体控制的效果具有决定性作用。目前,智能汽车信息感知水平还不能满足全工况、复杂环境下全自动驾驶的要求。本项目面向智能汽车环境感知和地图构建的重大需求,综合运用模式识别、实车实验等方法,围绕智能汽车在信息缺失条件下的感知和场景构建、多源传感信息的融合、考虑人车路因素的综合安全风险态势评估等关键问题开展研究,重点探索基于地理视觉标签的高精度动态定位技术、信息缺失条件下的多源信息精细感知与深度融合方法、基于驾驶行为理解与拟人认知的行车驾驶场景地图建模方法、基于“驾乘意图—车辆状态—动态环境”的碰撞风险综合态势感知方法,并通过实车和驾驶仿真实验进行测试验证,课题研究成果可补充和完善现有的环境感知和地图场景构建相关理论,为智能汽车的发展与应用提供理论支撑。

Application Abstract: Environmental perception and modeling is the core content of intelligent vehicle.Whether the environmental information can be processed and analyzed correctly and promptly is directly related to the safety and efficiency of intelligent vehicle operation.It plays an important role in the path planning and the effect of vehicle control.At present,the level of information perception of intelligent vehicle can’t meet the requirements of automatic driving under full situation and complex environment.This project aims at the major needs of intelligent vehicle’s environmental perception and map construction.It will comprehensively use pattern recognition and real vehicle experiment methods.The research focuses on the key issues such as intelligent vehicle perception and map construction under inadequate information condition,the integration of multi-source sensing information,and comprehensive safety risk assessment considering human,vehicle and road factors.The focal point of this project is to explore the high precision dynamic positioning technology based on geographic visual labeling,precise perception and deep fusion of multi-source information under information missing condition,modeling method of driving scenario based on driving behavior understanding and person-attendance,and collision risk integrated situation sensing method based on"driving intention-vehicle state-dynamic environment".Finally the methods will be verified by field experiment and driving simulation experiment.The research results can complement and improve the existing environmental perception and map scene construction theory.It will provide the development and application of intelligent vehicles with strong support.

项目受资助省

湖北省

项目结题报告(全文)

环境精细感知、深度融合与动态建模是智能汽车的核心内容,环境信息能否正确及时的处理、分析直接关系到智能车辆运行的安全和效率,对路径规划和车体控制的效果具有决定性作用。目前,智能汽车信息感知水平还不能满足全工况、复杂环境下全自动驾驶的要求。本项目面向智能汽车环境感知和驾驶地图构建的重大需求,提出了基于地理标签的低成本、高精度、车道级相对定位方法,构建了部分传感器信息缺失下智能车感知信息补偿方法,提出了基于驾驶行为理解与场景信息拟人认知的行车驾驶场景地图建模方法,建立了智能车行车风险量化和评估模型,并在城市复杂环境下进行测试验证。本项目的研究成果补充和完善了现有的环境感知和地图场景构建相关理论,为智能汽车的发展与应用提供理论支撑,能够促进智能汽车的应用和推广。

  • 排序方式:
  • 2
  • /
  • 1.Single-stage Multi-scale Receptive Field Improvement Lightweight Object Detection Network Based on MobileNetV3

    • 关键词:
    • Computing power;Convolution;Feature extraction;Object recognition;Attention mechanisms;Computing power;Features fusions;Lightweight network;Multi-scales;Objects detection;Receptive fields;Single stage;Small target detection;Targets detection
    • Tong, Zhenkai;Wu, Yefu;Liu, Yang
    • 《21st International Symposium on Distributed Computing and Applications for Business Engineering and Science, DCABES 2022》
    • 2022年
    • October 14, 2022 - October 18, 2022
    • Chizhou, China
    • 会议

    The computing power of edge devices is difficult to keep up with the development of modern computer technology, and the computing power is not improved enough. In practical application environments, so there is the birth of lightweight models. Lightweight models specifically refer to some models with simple model architecture and low computational load. Although the lightweight model is fast and the model is relatively simple, the detection effect is not very good. This paper proposes a parallel convolution module, performs feature fusion through parallel processing of multi-scale convolution kernels, and then integrates the spatial channel attention mechanism into the module to implement a multi-scale target detection module on a single feature layer. Model fusion proposes anchor boxes to generate heads and become a single-stage object detection model. © 2022 IEEE.

    ...
  • 2.Road-pulse: Pavement vibration features from accelerator to enhance intelligent vehicle localization

    • 关键词:
    • Vehicles;Vibrations (mechanical);Markov processes;Gaussian modeling;Image features;Intelligent vehicle localizations;Map constructions;Pulse pattern;Pulse-like;Speed bumps;Vehicle localization;Vibration pattern
    • Zhou, Zhe;Hu, Zhaozheng;Li, Na;Xiao, Hanbiao;Zhang, Jianan
    • 《32nd IEEE Intelligent Vehicles Symposium, IV 2021》
    • 2021年
    • July 11, 2021 - July 17, 2021
    • Nagoya, Japan
    • 会议

    Speed bumps and expansion joints widely available on pavements cause pulse-like vibrations that can be measured by an in-vehicle accelerator. Such vibration patterns are called road-pulses in this paper, and we proposed a sliding Gaussian model (SGM) for detection. The detected road-pulses are associated with accurate positions and image features for road-pulse map construction. In the localization step, road-pulse patterns are detected and matched with the road-pulse map. And the corresponding image features and positions stored in the map allow accurate vehicle localization afterward. The proposed road-pulse-based localization is integrated into a downward pavement visual odometry with a Kalman filter based on the second-order Markov model (KF-MM2) for enhancing vehicle localization. The proposed method was validated on two different pavement conditions. Experimental results demonstrate that the proposed method can greatly improve vehicle localization with low cost and high feasibility.
    © 2021 IEEE.

    ...
  • 3.Road-pulse: Pavement vibration features from accelerator to enhance intelligent vehicle localization

    • 关键词:
    • Vehicles ; Vibrations (mechanical) ; Markov processes;Gaussian modeling ; Image features ; Intelligent vehicle localizations ; Map constructions ; Pulse pattern ; Pulse;like ; Speed bumps ; Vehicle localization ; Vibration pattern
    • ZhouZhe;HuZhaozheng;LiNa;XiaoHanbiao;ZhangJianan
    • 《32nd IEEE Intelligent Vehicles Symposium, IV 2021》
    • 2021年
    • July 11, 2021 - July 17, 2021
    • Nagoya, Japan
    • 会议

    Speed bumps and expansion joints widely available on pavements cause pulse-like vibrations that can be measured by an in-vehicle accelerator. Such vibration patterns are called road-pulses in this paper, and we proposed a sliding Gaussian model (SGM) for detection. The detected road-pulses are associated with accurate positions and image features for road-pulse map construction. In the localization step, road-pulse patterns are detected and matched with the road-pulse map. And the corresponding image features and positions stored in the map allow accurate vehicle localization afterward. The proposed road-pulse-based localization is integrated into a downward pavement visual odometry with a Kalman filter based on the second-order Markov model (KF-MM2) for enhancing vehicle localization. The proposed method was validated on two different pavement conditions. Experimental results demonstrate that the proposed method can greatly improve vehicle localization with low cost and high feasibility. © 2021 IEEE.

    ...
  • 4.Statistical Analysis of the Characteristics of Ship Accidents for Chongqing Maritime Safety Administration District

    • 关键词:
    • Accidents;Ships;Risk analysis;Decision support systems;Statistics;Risk assessment;Rivers;Waterway transportation;Decision supports;Material distribution;Prevention and controls;Social stability;Spatiotemporal distributions;Statistical datas;Three Gorges project;Water environments
    • Xue, Jie;Papadimitriou, Eleonora;Wu, Chaozhong;Van Gelder, P.H.A.J.M.
    • 《2020 Forum on Integrated and Sustainable Transportation Systems, FISTS 2020》
    • 2020年
    • November 3, 2020 - November 5, 2020
    • Delft, Netherlands
    • 会议

    The Yangtze River is the first of China and the third-longest river in the world. It is the most developed inland water transportation system in China. Chongqing, located in the upstream of the Three Gorges Project, is not only the gateway of the industrial and commercial center of China but also the most abundant water and intermodal inland hub and material distribution center in the southwest. Frequent water traffic accidents pose severe threats to the safety of human life and property and the water environment as well as bring adverse effects on social stability. Therefore, based on the ten years of statistical data of ship accidents in 2009-2018 from the Chongqing Maritime Safety Administration (MSA), this paper summarizes the characteristics of the spatiotemporal distribution of accidents through statistical analysis of the historical data. Moreover, it proposes accident prevention and supervision methods to provide decision support for maritime safety. This research is of great significance to the prevention and control of water traffic accidents in this region. © 2020 IEEE.

    ...
  • 5.A Simple Method of Millimeter Wave Radar Installation Correction

    • 关键词:
    • Stereo vision;Installation;Millimeter waves;Radar;Stereo image processing;Calibration site;Co-ordinate system;Levenberg Marquardt optimizations;Millimeter wave radar;Objective functions;Random sampling method;SIMPLE method;Stereo calibration
    • Xiong, Xinli;Wang, Kuan;Chen, Jianbin;Xiong, Zhoubing;Liang, Fenghua;Ma, Yunlin
    • 《32nd Chinese Control and Decision Conference, CCDC 2020》
    • 2020年
    • August 22, 2020 - August 24, 2020
    • Hefei, China
    • 会议

    In this paper we propose a method of millimeter wave radar installation correction. The two main processes of installation correction are the acquisition of the true position of the target and the establishment and solution of the relationship between the true position and the position detected by the millimeter wave radar. First, we designed and made a 10∗30m calibration site to get the real position of the target. Second, based on the principle of stereo calibration in computer vision, the relationship between the millimeter wave radar and the car front bumper center coordinate system is constructed, and then an algorithm based on the Levenberg-Marquardt optimization is used to solve the objective function. Finally, a random sampling method is used to collect data to verify the effectiveness of the proposed method. The experimental results show that the proposed method can effectively correct the installation deviation of millimeter wave radar. © 2020 IEEE.

    ...
  • 6.Research on Longitudinal following Control of Platoon Based on Nonlinear PID

    • 关键词:
    • MATLAB;Speed;Three term control systems;Accidents;Longitudinal control;Vehicle to vehicle communications;Vehicles;Cooperative communication;Communication topologies;Environmental pollutions;Formation maintenances;Inverse dynamics models;Longitudinal controllers;Nonlinear PID controllers;PID feedback controls;Vehicle communications
    • Liu, Hongxiang;Chu, Duanfeng;Peng, Weifeng;Lu, Liping;Peng, Feng
    • 《SAE 3rd International Forum on Connected Automated Vehicle Highway System through the China Highway and Transportation Society, CHTS 2020》
    • 2020年
    • October 29, 2020
    • Jinan, China
    • 会议

    Intelligent vehicle formation can improve the driving status of vehicle platoon, increase road traffic flow, reduce traffic accidents, reduce environmental pollution and save energy. As an important part of cooperative platoon control system, cooperative platoon longitudinal speed following control has an important influence on the overall performance of vehicle platoon. To solve the longitudinal speed following control problem of cooperative vehicle platoon, a longitudinal following control strategy based on nonlinear proportion, integration, differentiation (PID) is proposed on the premise of fully considering the delay of vehicle actuator, the delay of vehicle communication and vehicle platoon stability. According to the communication topology structure of Predecessor-Leader Following, the information of platoon state is obtained, and the strategy of constant spacing is adopted. A layered vehicle platoon longitudinal controller is designed based on nonlinear PID control. The expected speed and expected acceleration are obtained by calculation, and the throttle opening or brake pressure is obtained according to the vehicle inverse dynamics model and PID feedback control to realize the longitudinal following control of the vehicle platoon. To verify the validity of the controller, co-simulation with MATLAB/Simulink and CarSim. The simulation results show that compared with the traditional PID control, the speed extremum, acceleration extremum and vehicle spacing extremum of the nonlinear PID controller designed in this paper can be improved by 0.14 m/s and 0.28 m/s, 0.05 m/s2 and 0.09 m/s2, 0.26 m and 0.22 m under two different conditions, which can effectively improve the longitudinal following state of the platoon, realize the speed cruise and formation maintenance of the vehicle platoon. © 2020 SAE International.

    ...
  • 7.Lane Detection Based on Histogram of Oriented Vanishing Points

    • 关键词:
    • Automobile drivers;Advanced driver assistance systems;Real time systems;Automated driving;Driving assistance systems;Histogram;Lane detection;Local thresholds;Onboard camera;Public dataset;Vanishing point
    • Chen, Shizeng;Li, Bijun;Guo, Yuan;Zhou, Jian
    • 《5th Asian Conference on Pattern Recognition,ACPR 2019》
    • 2020年
    • November 26, 2019 - November 29, 2019
    • Auckland, New zealand
    • 会议

    As an important role in autonomous vehicles or advanced driving assistance systems, lane detection uses the onboard camera high up on the windshield to provide the vehicle’s lateral offset within its own lane in a real-time, low-cost way. In this paper, we propose an efficient, robust lane detection method based on histogram of oriented vanishing points. First, the lane features are extracted by symmetrical local threshold. Then, the lines are generated from oriented vanishing points. The lines crossing most features are selected and oriented vanishing points are updated by the overlap between features and selected lines. Last step will be repeated for getting stable oriented vanishing points. Therefore, the last selected lines are most likely to be lane lines. Finally, Validate and select the best lane lines. The proposed method has been tested on a public dataset. The experimental results show that the method can improve robustness under real-time automated driving. © 2020, Springer Nature Singapore Pte Ltd.

    ...
  • 8.Longitudinal tracking control of vehicle platooning using DDPG-based PID

    • 关键词:
    • Deep learning;Reinforcement learning;Controllers;Proportional control systems;Simulation platform;Two term control systems;Industrial research;Longitudinal control;Vehicles;Automated vehicles;Conventional pid;Cooperative adaptive cruise control;Hardwarein-the-loop(HIL) simulation;Industrial fields;Maximum distance;Proportional integral derivatives;Tracking controls
    • Yang, Junru;Liu, Xingliang;Liu, Shidong;Chu, Duanfeng;Lu, Liping;Wu, Chaozhong
    • 《4th CAA International Conference on Vehicular Control and Intelligence, CVCI 2020》
    • 2020年
    • December 18, 2020 - December 20, 2020
    • Hangzhou, China
    • 会议

    Cooperative adaptive cruise control (CACC) has important significance for the development of the connected and automated vehicle (CAV) industry. In this paper, a learning control method combined Deep Deterministic Policy Gradient and Proportional-Integral-Derivative (DDPG-PID) controller is proposed. The main contribution of this study is automating the PID weight tuning process by formulating this objective as a deep reinforcement learning (DRL) problem. Based on the Hardware-in-the-Loop (HIL) simulation platform, the DDPG-PID controller is compared with the conventional PID controller under the test condition. Experiment results indicate that on 38.95% stability time in vehicular platooning system is decreased by utilizing the proposed method. The performance of maximum distance error is also improved efficiently, which is reduced by 60.94%. The research in this paper is a further development of learning control method and provides a new idea for the practical application of DRL algorithm in industrial field. © 2020 IEEE.

    ...
  • 9.Research for temporal and spatial distribution of ship accidents in the fluctuating backwater area of three gorges reservoir region

    • 关键词:
    • Reservoirs (water);Losses;Visualization;Rivers;Spatial distribution;Ships;Water;Material distribution;Navigation conditions;Temporal and spatial distribution;Three Gorges project;Three gorges reservoir;Three gorges reservoir area;Three Gorges Reservoir region;Visualization method
    • Xue, Jie;van Gelder, P.H.A.J.M.;Papadimitriou, Eleonora;Jiang, Dan;Wu, Chaozhong
    • 《30th European Safety and Reliability Conference, ESREL 2020 and 15th Probabilistic Safety Assessment and Management Conference, PSAM15 2020》
    • 2020年
    • November 1, 2020 - November 5, 2020
    • Venice, Italy
    • 会议

    The Yangtze River is the main artery of the inland water transportation of China, connecting the resource-rich southwest hinterland, the Central China region and the economically prosperous southeast coast of East China. Chongqing, located in the fluctuating backwater of the Three Gorges Project, is the mainstream of the Yangtze River and the Jialing River. It is not only the industrial and commercial center of China but also the most abundant water and intermodal inland hub and material distribution center in the southwest. Based on the ten years of statistical data of ship accidents from 2009 to 2018 of the Chongqing Maritime Safety Administration (MSA), this paper takes the navigation section of the fluctuating backwater area of the Three Gorges Reservoir as the research object, and comprehensively uses statistical analysis, comparative analysis, and data visualization methods. The temporal and spatial distribution characteristics of ship accidents in the fluctuating backwater area and the economic losses in this area are studied. The research results are helpful for strengthening maritime management, improving navigation conditions, and reducing water traffic accidents in the Three Gorges Reservoir area and other similar reservoir areas all over the world. In addition, the research gives detailed guidance for stakeholders and mangers for the prevention of water traffic accidents. © ESREL2020-PSAM15 Organizers.Published by Research Publishing, Singapore.

    ...
  • 10.Research on Longitudinal following Control of Platoon Based on Nonlinear PID

    • 关键词:
    • MATLAB;Speed;Three term control systems;Accidents;Longitudinal control;Vehicle to vehicle communications;Vehicles;Cooperative communication;Communication topologies;Environmental pollutions;Formation maintenances;Inverse dynamics models;Longitudinal controllers;Nonlinear PID controllers;PID feedback controls;Vehicle communications
    • Liu, Hongxiang;Chu, Duanfeng;Peng, Weifeng;Lu, Liping;Peng, Feng
    • 《SAE 3rd International Forum on Connected Automated Vehicle Highway System through the China Highway and Transportation Society, CHTS 2020》
    • 2020年
    • October 29, 2020
    • Jinan, China
    • 会议

    Intelligent vehicle formation can improve the driving status of vehicle platoon, increase road traffic flow, reduce traffic accidents, reduce environmental pollution and save energy. As an important part of cooperative platoon control system, cooperative platoon longitudinal speed following control has an important influence on the overall performance of vehicle platoon. To solve the longitudinal speed following control problem of cooperative vehicle platoon, a longitudinal following control strategy based on nonlinear proportion, integration, differentiation (PID) is proposed on the premise of fully considering the delay of vehicle actuator, the delay of vehicle communication and vehicle platoon stability. According to the communication topology structure of Predecessor-Leader Following, the information of platoon state is obtained, and the strategy of constant spacing is adopted. A layered vehicle platoon longitudinal controller is designed based on nonlinear PID control. The expected speed and expected acceleration are obtained by calculation, and the throttle opening or brake pressure is obtained according to the vehicle inverse dynamics model and PID feedback control to realize the longitudinal following control of the vehicle platoon. To verify the validity of the controller, co-simulation with MATLAB/Simulink and CarSim. The simulation results show that compared with the traditional PID control, the speed extremum, acceleration extremum and vehicle spacing extremum of the nonlinear PID controller designed in this paper can be improved by 0.14 m/s and 0.28 m/s, 0.05 m/s2 and 0.09 m/s2, 0.26 m and 0.22 m under two different conditions, which can effectively improve the longitudinal following state of the platoon, realize the speed cruise and formation maintenance of the vehicle platoon. © 2020 SAE International.

    ...
  • 排序方式:
  • 2
  • /