Enhancing Adversarially Robust Learning via Transformed Low-rank Tensor Representations

项目来源

日本学术振兴会基金(JSPS)

项目主持人

WANG Andong

项目受资助机构

国立研究開発法人理化学研究所

立项年度

2025

立项时间

未公开

项目编号

25K21283

研究期限

未知 / 未知

项目级别

国家级

受资助金额

4810000.00日元

学科

知能情報学関連

学科代码

未公开

基金类别

若手研究

关键词

tensor decomposition ; adversarial robustness ; data representation ; weight representation ; function representation

参与者

未公开

参与机构

国立研究開発法人理化学研究所,革新知能統合研究センター

项目标书摘要:Outline of Research at the Start:This project tackles the challenge of adversarial robustness in AI,focusing on large-scale and multi-modal systems.We propose Transformed Low-rank Tensor Networks(TLTNs)to enhance robustness and efficiency.The research includes:(1)Data Representation:TLTNs model low-rankness and smoothness in complex data;(2)Function Representation:TLTNs enable expressive and structured multi-variate function approximation;(3)Adversarial Training:TLTNs support efficient,scalable training methods for robust models;(4)Adversarial Purification:TLTNs detect and remove adversarial noise。

  • 排序方式:
  • 1
  • /
  • 1.Multi-view subspace tensorization with attentive clustering embedding

    • 关键词:
    • Clustering algorithms;Deep learning;Embeddings;Clustering methods;Clusterings;Embeddings;High order correlation;Higher order correlation;Multi-view clustering;Multi-view learning;Multi-views;Subspace clustering;Tensor based approach
    • Zheng, Yanghang;Huang, Haonan;Luo, Yihao;Qiu, Yuning;Wang, Andong;Zhou, Guoxu;Zhao, Qibin
    • 《Neural Networks》
    • 2026年
    • 196卷
    • 期刊

    Deep learning-based multi-view clustering (DMVC) has garnered significant attention and achieved remarkable success, primarily due to its powerful nonlinear representation capabilities. However, most existing DMVC methods fall short in effectively modeling the inherent high-order correlations among different views. In contrast, traditional MVC techniques have long recognized the effectiveness of tensor-based approaches in capturing such complex interactions. To bridge this gap, we propose STANCE (multi-view Subspace Tensorization with Attentive Clustering Embedding), a novel DMVC framework that integrates tensor modeling into a deep learning paradigm. Specifically, STANCE first employs view-specific auto-encoders to project raw data into latent feature spaces, enabling robust subspace representations. These representations are then stacked to construct a third-order tensor, upon which a Tensor-based low-rank constraint is imposed to explicitly capture high-order inter-view dependencies. To further enhance consistency across views, STANCE incorporates an attention-based adaptive fusion module that dynamically assigns weights to view-specific representations at the sample level, thereby extracting consistent information from features that are both similar and confident. Comprehensive experiments, encompassing parameter analysis, ablation studies, and visual comparisons, are conducted to thoroughly evaluate the effectiveness of STANCE. The results demonstrate that STANCE significantly outperforms state-of-the-art methods on various benchmark datasets. © 2025 Elsevier Ltd

    ...
  • 2.A Tensorized Structural Anchor-Based Method forScalable Multi-view Subspace Clustering

    • 关键词:
    • Cluster analysis;Clustering algorithms;Large datasets;'current;Clusterings;High-order;Higher-order;Intrinsic data;Multi-view learning;Multi-views;Performance;Subspace clustering;Tensor learning
    • Huang, Haonan;Wang, Andong;Qiu, Yuning;Zhou, Guoxu;Zhao, Qibin
    • 《32nd International Conference on Neural Information Processing, ICONIP 2025》
    • 2026年
    • November 20, 2025 - November 24, 2025
    • Okinawa, Japan
    • 会议

    Multi-view subspace clustering optimizes accuracy through the integration of intrinsic data from diverse views. However, current methods, despite their strong clustering performance, grapple with scalability due to high time complexity. The potential of anchor-based models to address this challenge is noteworthy, yet they often disregard higher-order relationships and crucial complementary insights that exist among views. To tackle these issues, we present a Tensorized Structural Anchor-based Method for Scalable Multi-view Subspace Clustering (TSA-SMSC). Firstly, TSA-SMSC characterizes the high-order collections by minimizing the tensor regularization on the third-order tensor, which comprises anchor graph matrices from different views. More importantly, we propose a novel self-weighted tensor logarithmic Schatten-p function, which enables us to effectively capture structural complementarity by incorporating the distinctions between singular values using adaptive weights. Finally, we design a structural fusion term to constrain connected components in anchor graphs and facilitate consensus representation. Extensive experiments on six large-scale datasets demonstrate the superiority of our proposed framework. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2026.

    ...
  • 3.Low-Rank Tensor Transitions (LoRT) for Transferable Tensor Regression

    • 关键词:
    • Data accuracy;Knowledge management;Regression analysis;Covariate shifts;Decentralised;Improve performance;In-field;Learning strategy;Multi dimensional;Neuroimaging Analysis;Sample sizes;Spatiotemporal analysis;Transfer learning
    • Wang, Andong;Qiu, Yuning;Jin, Zhong;Zhou, Guoxu;Zhao, Qibin
    • 《42nd International Conference on Machine Learning, ICML 2025》
    • 2025年
    • July 13, 2025 - July 19, 2025
    • Vancouver, BC, Canada
    • 会议

    Tensor regression is a powerful tool for analyzing complex multi-dimensional data in fields such as neuroimaging and spatiotemporal analysis, but its effectiveness is often hindered by insufficient sample sizes. To overcome this limitation, we adopt a transfer learning strategy that leverages knowledge from related source tasks to improve performance in data-scarce target tasks. This approach, however, introduces additional challenges including model shifts, covariate shifts, and decentralized data management. We propose the Low-Rank Tensor Transitions (LoRT) framework, which incorporates a novel fusion regularizer and a two-step refinement to enable robust adaptation while preserving low-tubal-rank structure. To support decentralized scenarios, we extend LoRT to D-LoRT, a distributed variant that maintains statistical efficiency with minimal communication overhead. Theoretical analysis and experiments on tensor regression tasks, including compressed sensing and completion, validate the robustness and versatility of the proposed methods. These findings indicate the potential of LoRT as a robust method for tensor regression in settings with limited data and complex distributional structures. © 2025 by the author(s).

    ...
  • 排序方式:
  • 1
  • /