CAREER:Exact Optimal and Data-Adaptive Algorithms and Tools for Differential Privacy
项目来源
项目主持人
项目受资助机构
财政年度
立项时间
项目编号
项目级别
研究期限
受资助金额
学科
学科代码
基金类别
关键词
参与者
参与机构
人员信息
机构信息
项目主管部门
项目官员
1.Revisiting model-agnostic private learning: Faster rates and active learning
- 关键词:
- Artificial intelligence ; Learning systems;Active Learning ; Differential privacies ; Faster rates ; Learn+ ; Model;agnostic private learning ; Noise conditions ; Private aggregation of teacher ensemble ; Private aggregations ; Teachers' ; Tsybakov noise condition
- LiuChong;ZhuYuqing;ChaudhuriKamalika;WangYu-Xiang
- 《Journal of Machine Learning Research》
- 2021年
- 22卷
- 期
- 期刊
The Private Aggregation of Teacher Ensembles (PATE) framework is one of the most promising recent approaches in differentially private learning. Existing theoretical analysis shows that PATE consistently learns any VC-classes in the realizable setting, but falls short in explaining its success in more general cases where the error rate of the optimal classifier is bounded away from zero. We fill in this gap by introducing the Tsybakov Noise Condition (TNC) and establish stronger and more interpretable learning bounds. These bounds provide new insights into when PATE works and improve over existing results even in the narrower realizable setting. We also investigate the compelling idea of using active learning for saving privacy budget, and empirical studies show the effectiveness of this new idea. The novel components in the proofs include a more refined analysis of the majority voting classifier — which could be of independent interest — and an observation that the synthetic "student" learning problem is nearly realizable by construction under the Tsybakov noise condition. ©2021 Chong Liu, Yuqing Zhu, Kamalika Chaudhuri, and Yu-Xiang Wang.
...
