実時間で詳細な髪の動きを自然に表現するための学習ベース物理指向変形手法の開発

项目来源

日本学术振兴会基金(JSPS)

项目主持人

金井 崇

项目受资助机构

東京大学

项目编号

25K15401

立项年度

2025

立项时间

未公开

项目级别

国家级

研究期限

未知 / 未知

受资助金额

4680000.00日元

学科

エンタテインメントおよびゲーム情報学関連

学科代码

未公开

基金类别

基盤研究(C)

关键词

髪アニメーション ; 学習ベース ; 大規模データセット ; 物理指向変形手法 ; LBS

参与者

未公开

参与机构

東京大学,大学院総合文化研究科

项目标书摘要:Outline of Research at the Start:本研究は,キャラクタアニメーションにおける髪の動きをリアルに再現するための,新たな学習ベースの実時間物理指向変形手法を開発する.従来の物理シミュレーションは,膨大な計算リソースが必要であり,実時間での処理が困難であるのに対し,本研究では,物理シミュレーションを用いずに実時間での自然な髪の動きを実現することを目指している.さらに,大規模な髪の動作データセットを構築し,公開することで,学術的独自性を高めるとともに,学習ベースの髪アニメーション研究の進展に大きく貢献する。

  • 排序方式:
  • 1
  • /
  • 1.Hybrid learning with multi-scale graphs for enhanced garment deformation approximation

    • 关键词:
    • Clothes;Graph structures;Hosiery manufacture;Supervised learning;'current;Attribution analyze;Clothing deformation;Fine-scale;Generalized pattern;Graph pooling;Hybrid learning;Learn+;Multi-scales;Physical laws
    • Li, Tianxing;Shi, Rui;Zhu, Qing;Kanai, Takashi
    • 《Applied Soft Computing》
    • 2026年
    • 186卷
    • 期刊

    Due to the complex behavior of clothing, modeling fine-scale garment deformation on arbitrary meshes within a unified network presents a considerable challenge. Current methods often fail to learn generalized patterns that adhere to physical laws in a controllable manner, compromising efficiency and realism in practical applications. To overcome these limitations, we introduce a novel hybrid learning approach that accurately simulates garment dynamics and intricate details. The core of our method is a progressive learning scheme that integrates the accuracy of supervised learning with the physical awareness derived from unsupervised learning. Additionally, after analyzing the nature of the garment self-collision problem, we introduce vertex repulsion-based constraints that effectively prevent conspicuous intersections within the mesh while preserving fine details. Finally, to ensure effective propagation of node information across the mesh, we propose a multi-scale graph processing technique for the garment deformation task, featuring structure-preserving pooling and unpooling strategies that significantly enhance result quality. The experimental results demonstrate that our method outperforms the state-of-the-art under multiple metric evaluations. © 2025 Elsevier B.V.

    ...
  • 2.Frequency-Divided Learning of Fine-Grained Clothing Behavior via Flexible Dynamic Graphs

    • 关键词:
    • Clothing; Deformation; Shape; Frequency conversion; Training;Optimization; Frequency-domain analysis; Deformable models; Animation;Three-dimensional displays; Clothing deformation; frequency division;graph message-passing; physical-informed learning;DEFORMATION; SHAPE
    • Li, Tianxing;Shi, Rui;Kanai, Takashi;Zhu, Qing
    • 《IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS》
    • 2025年
    • 31卷
    • 10期
    • 期刊

    Despite significant advancements in neural simulation techniques for clothing animation, these methods struggle to capture the dynamic details of garments during movement. This limitation restricts their applicability in scenarios where high-quality garment deformation is essential. To address this challenge, we introduce a novel graph learning-based approach to enhance deformation realism through designed mechanisms for mesh information propagation and external optimization strategies during model training. First, we address the issue of over-smoothing common in conventional graph processing techniques by introducing a flexible message-passing method. This approach effectively manages node interactions within the mesh, thereby improving the expressiveness of the model. Furthermore, acknowledging that uniform model supervision typically neglects high-frequency details during optimization, we analyze the spectral properties of clothing meshes. Based on this analysis, we introduce a frequency-division constraint aligned with the characteristics of different frequency bands, which aids in precisely controlling the generation of details. Our model further integrates self-collision and other physics-aware losses, enabling the learning of generalized and fine-grained dynamic deformations. Extensive evaluations and comparisons demonstrate the effectiveness of our approach, showing notable improvements over existing state-of-the-art solutions.

    ...
  • 3.Spectrum-Enhanced Graph Attention Network for Garment Mesh Deformation

    • 关键词:
    • Garment deformation; spectral bias; graph attention network; mesh-basedsimulation; Garment deformation; spectral bias; graph attention network;mesh-based simulation
    • Li, Tianxing;Shi, Rui;Zhu, Qing;Zhang, Liguo;Kanai, Takashi
    • 《IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE》
    • 2025年
    • 47卷
    • 8期
    • 期刊

    We present a novel solution for mesh-based deformation simulation from a spectral perspective. Unlike existing approaches that demand separate training for each garment or body type and often struggle to produce rich folds and lifelike dynamics, our method achieves the quality of physics-based simulations while maintaining superior efficiency within a unified model. The key to achieve this lies in the development of a spectrum-enhanced deformation network, a result of in-depth theoretical analysis bridging neural networks and garment deformations. This enhancement compels the network to focus on learning spectral information predominantly within the frequency band associated with intricate deformations. Furthermore, building upon standard blend skinning techniques, we introduce target-aware temporal skinning weights. The weights describe how the underlying human skeleton dynamically affects the mesh vertices according to the garment and body shape, as well as the motion state. We validate our method on various garments, bodies, and motions through extensive ablation studies. Finally, we conduct comparisons to confirm its superiority in generalization, deformation quality, and performance over several state-of-the-art methods.

    ...
  • 排序方式:
  • 1
  • /