Collaborative Research:CPS:Medium:ASTrA:Automated Synthesis for Trustworthy Autonomous Utility Services
项目来源
项目主持人
项目受资助机构
财政年度
立项时间
项目编号
项目级别
研究期限
受资助金额
学科
学科代码
基金类别
关键词
参与者
参与机构
人员信息
机构信息
项目主管部门
项目官员
1.Efficient Counterexample-Guided Fairness Verification and Repair of Neural Networks Using Satisfiability Modulo Convex Programming
- 关键词:
- Decision making;Ethical technology;Iterative methods;Neural networks;Neurons;Empirical evaluations;Ethical decision making;Fairness properties;High sensitivity;Network repairs;Neural-networks;Performance;Satisfiability;Similar individuals;Trained neural networks
- Fayyazi, Arya;Xiao, Yifeng;Nuzzo, Pierluigi;Pedram, Massoud
- 《34th Internationa Joint Conference on Artificial Intelligence, IJCAI 2025》
- 2025年
- August 16, 2025 - August 22, 2025
- Montreal, QC, Canada
- 会议
Ensuring fairness is essential for ethical decision-making in various domains. Informally, a neural network is considered fair if it treats similar individuals similarly in a given task. We introduce FaVeR (Fairness Verification and Repair), a framework for efficiently verifying and repairing pre-trained neural networks with respect to individual fairness properties. FaVeR ensures fairness via iterative search of high-sensitivity neurons and backward adjustment of their weights, guided by counterexamples generated from fairness verification using satisfiability modulo convex programming. By addressing fairness at the neuronal level, FaVeR aims to minimize the impact of neural network repair on overall performance. Empirical evaluations on common fairness datasets show that FaVeR achieves a 100% fairness repair rate across all models with an accuracy reduction of less than 2.27% and significantly lower average runtime than alternative repair methods. © 2025 International Joint Conferences on Artificial Intelligence. All rights reserved.
...2.Incentive Design for Safe Nash Equilibrium Learning in Large Populations via Control Barrier Functions
- 关键词:
- Agents;Decision making;Intelligent agents;Nash equilibrium;Barriers functions;Condition;Control barriers;Decisions makings;Dynamics models;Evolutionary dynamics;Incentive design;Large population;Nash equilibria;Undesirable state
- Xiao, Yifeng;Certório, Jair;Martins, Nuno C.;Shoukry, Yasser;Nuzzo, Pierluigi
- 《64th IEEE Conference on Decision and Control, CDC 2025》
- 2025年
- December 9, 2025 - December 12, 2025
- Rio de Janeiro, Brazil
- 会议
Many decision-making scenarios in engineering, sociology, and epidemiology, among other fields, can be effectively modeled by a large population of learning agents, captured by an evolutionary dynamics model (EDM), which can possibly act non-cooperatively and interact with an exogenous dynamical system (ES). In these systems, the agents' collective behavior can drive the ES into undesirable states and significantly compromise its stability and safety. In this paper, we propose a method using control barrier functions to design payoffs that can guide the population's strategy selection while ensuring safe and stable behavior of the ES. We first address the need to avoid undesirable population states in the EDM. We then extend our approach to coupled EDM-ES systems, where the designed payoffs can prevent undesirable states and guarantee convergence to a target state. Finally, we establish general conditions under which the designed payoffs remain effective across different classes of EDMs, ensuring broad applicability. Numerical simulations validate our approach in both standalone EDMs and coupled EDM-ES systems that satisfy the proposed conditions. © 2025 IEEE.
...3.A Safe Bayesian Learning Algorithm for Constrained MDPs with Bounded Constraint Violation
- 关键词:
- Bayesian networks;Bayesian learning;Constrained Markov decision process;Constrained MDPs;Constraint violation;Exploration and exploitation;Markov decision process models;Multiple-objectives;Regret bounds;Sampling-based;Trade off
- Kalagarla, Krishna C.;Jain, Rahul;Nuzzo, Pierluigi
- 《28th International Conference on Artificial Intelligence and Statistics, AISTATS 2025》
- 2025年
- May 3, 2025 - May 5, 2025
- Mai Khao, Thailand
- 会议
Constrained Markov decision process (CMDP) models are increasingly important in many applications with multiple objectives. When the model is unknown and must be learned online, it is desirable to ensure that the constraint is met, or at least the violation is bounded with time. In the recent literature, progress has been made on this very challenging problem, but with either unsatisfactory assumptions, such as the knowledge of a safe policy, or high cumulative regret. We propose the Safe-PSRL (posterior sampling-based RL) algorithm that does not need such assumptions and yet performs very well, both in terms of theoretical regret bounds as well as empirically. The algorithm efficiently trades-off exploration and exploitation using posterior sampling-based exploration, and yet provably suffers only bounded constraint violation using carefully-crafted pessimism. We establish a sub-linear Õ (H2.5√|S|2|A|K) upper bound on the Bayesian objective regret along with a bounded, i.e., Õ (1) constraint-violation regret over K episodes for an |S|-state, |A|action, and horizon H CMDP, which improves over state-of-the-art algorithms for the same setting. Copyright 2025 by the author(s).
...4.ANALYZING ADVERSARIAL VULNERABILITIES OF GRAPH LOTTERY TICKETS
- 关键词:
- ;
- Chowdhury, Subhajit Dutta;Ni, Zhiyu;Peng, Qingyuan;Kundu, Souvik;Nuzzo, Pierluigi
- 《49th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024》
- 2024年
- April 14, 2024 - April 19, 2024
- Seoul, Korea, Republic of
- 会议
Graph neural networks (GNNs) have displayed significant potential in various graph-based learning tasks. However, the computational demands of deploying GNNs on large-scale graphs can grow exponentially. A recent method, termed unified graph sparsification (UGS), shows that there exists a pair consisting of a subgraph and a sparse subnetwork, called graph lottery ticket (GLT), that can effectively speed up GNN inference. However, despite their advantages, the performance of GLTs against adversarial structure perturbations remains largely unexplored. In this paper, we investigate the resilience of GLTs against different structure perturbation attacks under the poisoning attack setting. The evaluation results show that the GLTs identified by UGS are vulnerable and exhibit a large drop in classification accuracy for the adversarially perturbed graphs. We then propose a new technique for defending UGS that leverages self-training to find GLTs that are more resilient and can achieve better performance than plain UGS. © 2024 IEEE.
...5.Computer-Aided Evaluation for Argument-Based Certification
- 关键词:
- Software design;Argument-based certification;Certification;Certification process;Computer-aided;Customizable;Development and operations;HMI;Property;Safety and securities;Safety practices
- Daw, Zamira;Wang, Timothy;Oh, Chanwook;Low, Matthew;Amundson, Isaac;Wang, Guoqiang;Melville, Ryan;Nuzzo, Pierluigi
- 《42nd IEEE/AIAA Digital Avionics Systems Conference, DASC 2023》
- 2023年
- October 1, 2023 - October 5, 2023
- Barcelona, Spain
- 会议
Next-generation certification processes are expected to be influenced by two dominant trends: customizable certification, as advocated by Overarching Properties (OPs), and the continuous and rapid delivery approach from the coupling of software development and operations (DevOps). In light of these trends, certification processes must adapt to support the ongoing evaluation of assurance while accommodating the emergence of new evidence and evolving safety and security practices, particularly for systems enabled by artificial intelligence (AI). These requirements call for the development of computer-aided evaluation tools that automate repetitive tasks and offer visualization aids to assist evaluators and applicants in making informed decisions. This paper aims to address the challenges associated with assurance evaluation via a survey-based analysis and proposes a user interface that streamlines the evaluation of certification arguments. © 2023 IEEE.
...6.Task Assignment, Scheduling, and Motion Planning for Automated Warehouses for Million Product Workloads
- 关键词:
- Warehouses;Automated warehouse;Cyclic motions;Motion-planning;Problem instances;Servicing problems;Sub-problems;Task motion;Tasks assignments;Tasks scheduling;Traffic flow
- Leet, Christopher;Oh, Chanwook;Lora, Michele;Koenig, Sven;Nuzzo, Pierluigi
- 《2023 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2023》
- 2023年
- October 1, 2023 - October 5, 2023
- Detroit, MI, United states
- 会议
We address the Warehouse Servicing Problem (WSP) in automated warehouses, which use teams of mobile robots to move products from shelves to packaging stations. Given a list of products, the WSP amounts to finding a motion plan which brings every product on the list from a shelf to a packaging station within a given time limit. The WSP consists of four subproblems, namely, deciding where to source and deposit a product (task formulation), who should transport each product (task assignment) and when (scheduling) and how (motion planning). These problems are NP-Hard individually and made more challenging by their interdependence. The difficulty of the WSP is compounded by the scale of automated warehouses, which use teams of hundreds of agents to transport thousands of products. In this paper, we present Contract-based Cyclic Motion Planning (CCMP), a novel contract-based methodology for solving the WSP at scale. CCMP decomposes a warehouse into a set of traffic system components. By assigning each component a contract which describes the traffic flows it can support, CCMP can generate a traffic flow which satisfies a given WSP instance. CCMP then uses a novel motion planner to transform this traffic flow into a motion plan for a team of robots. Evaluation shows that CCMP can solve WSP instances taken from real industrial scenarios with up to 1 million products while outperforming other methodologies for solving the WSP by up to 2.9×. © 2023 IEEE.
...7.Contract-Based Specification Refinement and Repair for Mission Planning
- 关键词:
- Formal specification;Repair;'current;Based specification;Best approximations;Mission planning;Mission requirements;Robotic missions;Specification refinements
- Mallozzi, Piergiuseppe;Incer, Inigo;Nuzzo, Pierluigi;Sangiovanni-Vincentelli, Alberto
- 《11th IEEE/ACM International Conference on Formal Methods in Software Engineering, FormaliSE 2023》
- 2023年
- May 14, 2023 - May 15, 2023
- Melbourne, VIC, Australia
- 会议
We address the problem of modeling, refining, and repairing formal specifications for robotic missions using assume-guarantee contracts. We show how to model mission specifications at various levels of abstraction and implement them using a library of pre-implemented specifications. Suppose the specification cannot be met using components from the library. In that case, we compute a proxy for the best approximation to the specification that can be generated using elements from the library. Afterward, we propose a systematic way to either 1) search for and refine the 'missing part' of the specification that the library cannot meet or 2) repair the current specification such that the existing library can refine it. Our methodology for searching and repairing mission requirements leverages the quotient, separation, composition, and merging operations between contracts. © 2023 IEEE.
...8.Co-Design of Topology, Scheduling, and Path Planning in Automated Warehouses
- 关键词:
- Mobile agents;Motion planning;Automated warehouse;Co-designs;Contract-based designs;Design frameworks;NP-hard;Problem instances;Servicing problems;Sub-problems;Task allocation;Traffic flow
- Leet, Christopher;Oh, Chanwook;Lora, Michele;Koenig, Sven;Nuzzo, Pierluigi
- 《2023 Design, Automation and Test in Europe Conference and Exhibition, DATE 2023》
- 2023年
- April 17, 2023 - April 19, 2023
- Antwerp, Belgium
- 会议
We address the warehouse servicing problem (WSP) in automated warehouses, which use teams of mobile agents to bring products from shelves to packing stations. Given a list of products, the WSP amounts to finding a plan for a team of agents which brings every product on the list to a station within a given timeframe. The WSP consists of four subproblems, concerning what tasks to perform (task formulation), who will perform them (task allocation), and when (scheduling) and how (path planning) to perform them. These subproblems are NP-hard individually and are made more challenging by their interdependence. The difficulty of the WSP is compounded by the scale of automated warehouses, which frequently use teams of hundreds of agents. In this paper, we present a methodology that can solve the WSP at such scales. We introduce a novel, contract-based design framework which decomposes an automated warehouse into traffic system components. By assigning each of these components a contract describing the traffic flows it can support, we can syn-thesize a traffic flow satisfying a given WSP instance. Component-wise search-based path planning is then used to transform this traffic flow into a plan for discrete agents in a modular way. Evaluation shows that this methodology can solve WSP instances on real automated warehouses. © 2023 EDAA.
...9.Contract-Based Control Synthesis with Barrier Functions for Vehicular Mission Planning
- 关键词:
- Computer circuits;Model checking;Temporal logic;Time varying control systems;Vehicle to vehicle communications;Vehicles;Barriers functions;Compositional control;Contract-based designs;Control barrier function;Control barriers;Control synthesis;Correct-by-construction design;Mission planning;Signal temporal logic;Synthesis method
- Waqas, Muhammad;Naik, Nikhil Vijay;Ioannou, Petros;Nuzzo, Pierluigi
- 《61st IEEE Conference on Decision and Control, CDC 2022》
- 2022年
- December 6, 2022 - December 9, 2022
- Cancun, Mexico
- 会议
We present a compositional control synthesis method based on assume-guarantee contracts with application to correct-by-construction design of vehicular mission plans. In our approach, a mission-level specification expressed in a fragment of signal temporal logic (STL) is decomposed into formulas whose predicates are defined on non-overlapping time intervals. The STL formulas are then mapped to aggregations of contracts associated with continuously differentiable time-varying control barrier functions. The barrier functions are used to constrain the lower-level control synthesis problem, which is solved via quadratic programming. Our approach can mitigate the conservatism of previous methods for task-driven control based on under-approximations. We illustrate its effectiveness on a case study motivated by vehicular mission planning under safety constraints as well as constraints imposed by traffic regulations under vehicle-to-vehicle and vehicle-to-infrastructure communication. © 2022 IEEE.
...10.ARACHNE: Automated Validation of Assurance Cases with Stochastic Contract Networks
- 关键词:
- Assurance cases; Confidence assessment; Bayesian networks
- Oh, Chanwook;Naik, Nikhil;Daw, Zamira;Wang, Timothy E.;Nuzzo, Pierluigi
- 《41st International Conference on Safety, Reliability, and Security ofComputer-Based Systems 》
- 2022年
- SEP 06-09, 2022
- Munich, GERMANY
- 会议
We present ARACHNE, a framework for the automated, compositional validation of assurance cases (ACs), i.e., structured arguments about the correctness or safety of a design. ARACHNE leverages assume-guarantee contracts, expressed in a stochastic logic formalism, to formally capture AC claims (guarantees) subject to their contexts (assumptions) as well as the sources of uncertainty associated with them. Given an AC, modeled as a hierarchical network of stochastic contracts, and a library of confidence models, expressed as a set of Bayesian networks, we propose a procedure that coordinates logic and Bayesian reasoning to check that the AC argument is sound and quantify its strength in terms of a confidence measure. The effectiveness of our approach is illustrated on case studies motivated by testing and validation of airborne and automotive system software.
...
