Paper 2022/146

Training Differentially Private Models with Secure Multiparty Computation

Sikha Pentyala, Davis Railsback, Ricardo Maia, Rafael Dowsley, David Melanson, Anderson Nascimento, and Martine De Cock

Abstract

We address the problem of learning a machine learning model from training data that originates at multiple data owners, while providing formal privacy guarantees regarding the protection of each owner's data. Existing solutions based on Differential Privacy (DP) achieve this at the cost of a drop in accuracy. Solutions based on Secure Multiparty Computation (MPC) do not incur such accuracy loss but leak information when the trained model is made publicly available. We propose an MPC solution for training DP models. Our solution relies on an MPC protocol for model training, and an MPC protocol for perturbing the trained model coefficients with Laplace noise in a privacy-preserving manner. The resulting MPC+DP approach achieves higher accuracy than a pure DP approach, while providing the same formal privacy guarantees. Our work obtained first place in the iDASH2021 Track III competition on confidential computing for secure genome analysis.

Metadata
Available format(s)
PDF
Category
Cryptographic protocols
Publication info
Preprint. MINOR revision.
Keywords
Secure Multiparty ComputationDifferential PrivacyLogistic Regression
Contact author(s)
sikha @ uw edu
drail @ uw edu
ricardo menezes @ aluno unb br
rafael dowsley @ monash edu
mence40 @ uw edu
andclay @ uw edu
mdecock @ uw ed
History
2022-02-12: received
Short URL
https://ia.cr/2022/146
License
Creative Commons Attribution
CC BY

BibTeX

@misc{cryptoeprint:2022/146,
      author = {Sikha Pentyala and Davis Railsback and Ricardo Maia and Rafael Dowsley and David Melanson and Anderson Nascimento and Martine De Cock},
      title = {Training Differentially Private Models with Secure Multiparty Computation},
      howpublished = {Cryptology ePrint Archive, Paper 2022/146},
      year = {2022},
      note = {\url{https://eprint.iacr.org/2022/146}},
      url = {https://eprint.iacr.org/2022/146}
}
Note: In order to protect the privacy of readers, eprint.iacr.org does not use cookies or embedded third party content.