| title | Differentially Private Deep Learning with Importance-based Adaptive Gradient Processing | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| booktitle | Proceedings of the 16th Asian Conference on Machine Learning | ||||||||||||||||||||
| year | 2025 | ||||||||||||||||||||
| volume | 260 | ||||||||||||||||||||
| series | Proceedings of Machine Learning Research | ||||||||||||||||||||
| month | 0 | ||||||||||||||||||||
| publisher | PMLR | ||||||||||||||||||||
| https://raw.githubusercontent.com/mlresearch/v260/main/assets/li25a/li25a.pdf | |||||||||||||||||||||
| url | https://proceedings.mlr.press/v260/li25a.html | ||||||||||||||||||||
| openreview | JMWJjg0FXe | ||||||||||||||||||||
| abstract | In recent years, with the rapid development of neural network technology, the application of deep learning in the field of artificial intelligence has made significant progress and improvement. However, during the training of neural network models, the utilization of datasets is involved, and these datasets may contain sensitive information from users. Attackers might exploit the well-trained models to gain access to this sensitive information, leading to privacy breaches. Considering this risk, some deep learning algorithms incorporate differential privacy technology to safeguard the privacy of the trained model. This protection comes at the cost of certain model performance, achieved by adding controllable random noise. In this paper, we propose a differential privacy deep learning algorithm based on the importance of each layer’s gradients, called DP-AdamILG. DP-AdamILG further mitigates the impact of noise addition on model performance. It accomplishes this by combining the dynamic privacy budget allocation strategy with the formation of noise gradients based on the importance of each layer’s gradients. And the algorithm’s privacy is theoretically proven. Experimental results show that the DP-AdamILG algorithm can reach good performance of the neural network model and show strong robustness. | ||||||||||||||||||||
| layout | inproceedings | ||||||||||||||||||||
| issn | 2640-3498 | ||||||||||||||||||||
| id | li25a | ||||||||||||||||||||
| tex_title | Differentially Private Deep Learning with Importance-based Adaptive Gradient Processing | ||||||||||||||||||||
| firstpage | 159 | ||||||||||||||||||||
| lastpage | 174 | ||||||||||||||||||||
| page | 159-174 | ||||||||||||||||||||
| order | 159 | ||||||||||||||||||||
| cycles | false | ||||||||||||||||||||
| bibtex_editor | Nguyen, Vu and Lin, Hsuan-Tien | ||||||||||||||||||||
| editor |
|
||||||||||||||||||||
| bibtex_author | Li, Ping and Liang, Mingwei and Jiang, Zhao and Zhang, Jun | ||||||||||||||||||||
| author |
|
||||||||||||||||||||
| date | 2025-01-14 | ||||||||||||||||||||
| address | |||||||||||||||||||||
| container-title | Proceedings of the 16th Asian Conference on Machine Learning | ||||||||||||||||||||
| genre | inproceedings | ||||||||||||||||||||
| issued |
|
||||||||||||||||||||
| extras |