项目来源

美国国家科学基金(NSF)

项目主持人

Mingyi Hong

项目受资助机构

UNIVERSITY OF MINNESOTA

项目编号

2414372

财政年度

2025,2024

立项时间

未公开

研究期限

未知 / 未知

项目级别

国家级

受资助金额

600000.00美元

学科

未公开

学科代码

未公开

基金类别

Standard Grant

关键词

Comm&Information Foundations ; Machine Learning Theory ; SMALL PROJECT ; NETWORK CODING AND INFO THEORY

参与者

未公开

参与机构

REGENTS OF THE UNIVERSITY OF MINNESOTA

项目标书摘要：Learning a structural model of dynamic decision-making helps us better understand and predict how agents,whether human or machine,make decisions over time in changing environments.Instead of just copying actions,this approach allows us to capture both the agent’s goals(preferences)and how it understands the world(environment dynamics).This provides a much deeper insight into behavior,enabling predictions about how the agent would act in new or unseen situations.Such models are valuable because they can help improve decision-making systems,allowing them to adapt and make reliable choices in complex real-world scenarios,such as personalized AI assistants,autonomous systems,or decision support tools.There is an urgent need for models and algorithms that can create such structural frameworks.The outcomes of this project will have broad applications,including areas like control systems,natural language processing,and autonomous driving.Moreover,these efforts offer valuable opportunities to enhance the optimization and reinforcement learning curriculum,engaging students from diverse backgrounds in cross-disciplinary research and K12 outreach initiatives.This project develops machine learning models of an agent’s dynamic decisions subject to structural constraints on observed behavior.Specifically,the agent’s observed behavior(data)is modeled as being consistent with the inter-temporal optimization of a reward function(preferences)given a representation of how the environment evolves pursuant to control actions(dynamics).Unlike behavioral cloning models,a structural model of observed control behavior is a solid basis to perform counterfactual analysis and/or transfer learning.However,developing structural models of control is computationally challenging and the statistical properties of structural estimators are not easy to characterize.This project aims to advance the state-of-the-art on methodologies for learning structural models of control,by considering a diverse set of data(including demonstration and preferences),and by considering both online and offline settings.Finally,extensive experiments will be conducted to evaluate and apply the proposed methodologies in aligning large language models(LLMs),and in autonomous driving.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人员信息

Mingyi Hong(Principal Investigator)：mhong@umn.edu；

机构信息

【University of Minnesota(Performance Institution)】StreetAddress：200 Union Street SE 4-174 Keller Hall,MINNEAPOLIS,Minnesota,United States/ZipCode：554552009；【REGENTS OF THE UNIVERSITY OF MINNESOTA】StreetAddress：2221 UNIVERSITY AVE SE STE 100,MINNEAPOLIS,Minnesota,United States/PhoneNumber：6126245599/ZipCode：554143074；

项目主管部门

Directorate for Computer and Information Science and Engineering(CSE)-Division of Computing and Communication Foundations(CCF)

项目官员

Phillip Regalia(Email：pregalia@nsf.gov；Phone：7032922981)