Ambiguity-aware multimodal planning for collaborative robotics surgery

项目来源

日本学术振兴会基金(JSPS)

项目主持人

DAVILA Ana

项目受资助机构

名古屋大学

立项年度

2025

立项时间

未公开

项目编号

25K21247

研究期限

未知 / 未知

项目级别

国家级

受资助金额

4810000.00日元

学科

ヒューマンインタフェースおよびインタラクション関連

学科代码

未公开

基金类别

若手研究

关键词

Intelligent robotics ; Multimodal systems

参与者

未公开

参与机构

名古屋大学,未来社会創造機構

项目标书摘要:Outline of Research at the Start:This project addresses surgical robot adaptation through ambiguity-aware multimodal planning,by creating calibration datasets with ambiguous instructions,implementing context-sensitive vision-language planners,and designing clarification mechanisms to enhance healthcare safety。

  • 排序方式:
  • 1
  • /
  • 1.LLM-based ambiguity detection in natural language instructions for collaborative surgical robots

    • 关键词:
    • Collaborative robots;Intelligent robots;Labeled data;Linguistics;Man machine systems;Natural language processing systems;Robotic surgery;Surgical equipment;Classification accuracy;Conformal predictions;Human-robot collaboration;Humans-robot interactions;Language model;Model-based OPC;Natural languages;Robot actions;Synthesised
    • Davila, Ana;Colan, Jacinto;Hasegawa, Yasuhisa
    • 《34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025》
    • 2025年
    • August 25, 2025 - August 29, 2025
    • Hybrid, Eindhoven, Netherlands
    • 会议

    Ambiguity in natural language instructions poses significant risks in safety-critical human-robot interaction, particularly in domains such as surgery. To address this, we propose a framework that uses Large Language Models (LLMs) for ambiguity detection specifically designed for collaborative surgical scenarios. Our method employs an ensemble of LLM evaluators, each configured with distinct prompting techniques to identify linguistic, contextual, procedural, and critical ambiguities. A chain-of-thought evaluator is included to systematically analyze instruction structure for potential issues. Individual evaluator assessments are synthesized through conformal prediction, which yields non-conformity scores based on comparison to a labeled calibration dataset. Evaluating Llama 3.2 11B and Gemma 3 12B, we observed classification accuracy exceeding 60% in differentiating ambiguous from unambiguous surgical instructions. Our approach improves the safety and reliability of human-robot collaboration in surgery by offering a mechanism to identify potentially ambiguous instructions before robot action. © 2025 IEEE.

    ...
  • 排序方式:
  • 1
  • /