journal article·2018-10-28Open access

Privacy-Preserving Monotonicity of Differential Privacy Mechanisms

Hai Liu, Zhenqiang Wu, Yihui Zhou, Changgen Peng, Feng Tian, Laifeng Lu

Applied Sciences· Volume 8· Issue 11

Abstract

Differential privacy mechanisms can offer a trade-off between privacy and utility by using privacy metrics and utility metrics. The trade-off of differential privacy shows that one thing increases and another decreases in terms of privacy metrics and utility metrics. However, there is no unified trade-off measurement of differential privacy mechanisms. To this end, we proposed the definition of privacy-preserving monotonicity of differential privacy, which measured the trade-off between privacy and utility. First, to formulate the trade-off, we presented the definition of privacy-preserving monotonicity based on computational indistinguishability. Second, building on privacy metrics of the expected estimation error and entropy, we theoretically and numerically showed privacy-preserving monotonicity of Laplace mechanism, Gaussian mechanism, exponential mechanism, and randomized response mechanism. In addition, we also theoretically and numerically analyzed the utility monotonicity of these several differential privacy mechanisms based on utility metrics of modulus of characteristic function and variant of normalized entropy. Third, according to the privacy-preserving monotonicity of differential privacy, we presented a method to seek trade-off under a semi-honest model and analyzed a unilateral trade-off under a rational model. Therefore, privacy-preserving monotonicity can be used as a criterion to evaluate the trade-off between privacy and utility in differential privacy mechanisms under the semi-honest model. However, privacy-preserving monotonicity results in a unilateral trade-off of the rational model, which can lead to severe consequences.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Privacy-Preserving Technologies in Data · Privacy, Security, and Data Protection · Mobile Crowdsensing and Crowdsourcing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science, Shaanxi Normal University, Xi’an 710119, China

Guizhou Provincial Key Laboratory of Public Big Data, Guizhou University, Guiyang 550025, China

School of Mathematics and Information Science, Shaanxi Normal University, Xi’an 710119, China

Funding

National Natural Science Foundation of China · Natural Science Basic Research Program of Shaanxi Province · Fundamental Research Founds for the Central Universties · Program of Key Science and Technology Innovation Team in Shaanxi Province · Open Project Fund of Guizhou Provincial Key Laboratory of Public Big Data

References (65)

Show source-provided references
1. The algorithmic foundations of differential privacy10.1561/0400000042 ↗
2. Hardt, M., and Rothblum, G.N. (2010, January 23–26). A multiplicative weights mechanism for privacy-preserving data analysis. Proceedings of the 51th Annual IEEE Symposium on Foundations of Computer Science, Las Vegas, NV, USA.10.1109/FOCS.2010.85 ↗
3. Chaudhuri, K., and Hsu, D. (July, January 26). Convergence rates for differentially private statistical estimation. Proceedings of the 29th International Conference on Machine Learning, Edinburgh, UK.
4. Blocki, J., Blum, A., Datta, A., and Sheffet, O. (2012, January 20–23). The johnson-lindenstrauss transform itself preserves differential privacy. Proceedings of the 53th Annual IEEE Symposium on Foundations of Computer Science, New Brunswick, NJ, USA.10.1109/FOCS.2012.67 ↗
5. Adaptive gaussian mechanism based on expected data utility under conditional filtering noise
6. Dwork, C., McSherry, F., Nissim, K., and Smith, A. (2006, January 4–7). Calibrating noise to sensitivity in private data analysis. Proceedings of the 3rd Theory of Cryptography Conference, New York, NY, USA.10.1007/11681878_14 ↗
7. Roth, A., and Roughgarden, T. (2010, January 5–8). Interactive privacy via the median mechanism. Proceedings of the 42nd ACM Symposium on Theory of Computing, Cambridge, MA, USA.10.1145/1806689.1806794 ↗
8. McSherry, F., and Talwar, K. (2007, January 20–23). Mechanism design via differential privacy. Proceedings of the 48th Annual IEEE Symposium on Foundations of Computer Science, Providence, RI, USA.10.1109/FOCS.2007.66 ↗
9. Randomized response: A survey technique for eliminating evasive answer bias10.1080/01621459.1965.10480775 ↗
10. Hardt, M., and Talwar, K. (2010, January 5–8). On the geometry of differential privacy. Proceedings of the 42nd ACM Symposium on Theory of Computing, Cambridge, MA, USA.10.1145/1806689.1806786 ↗
11. A supermodularity-based differential privacy preserving algorithm for data anonymization10.1109/TKDE.2013.107 ↗
12. Jorgensen, Z., Yu, T., and Cormode, G. (2015, January 13–17). Conservative or liberal? Personalized differential privacy. Proceedings of the 31th IEEE International Conference on Data Engineering, Seoul, Korea.10.1109/ICDE.2015.7113353 ↗
13. Individual differential privacy: A utility-preserving formulation of differential privacy guarantees10.1109/TIFS.2017.2663337 ↗
14. Cuff, P., and Yu, L. (2016, January 24–28). Differential privacy as a mutual information constraint. Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security, Vienna, Austria.10.1145/2976749.2978308 ↗
15. He, X., Machanavajjhala, A., and Ding, B. (2014, January 22–27). Blowfish privacy: Tuning privacy-utility trade-offs using policies. Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, Snowbird, UT, USA.10.1145/2588555.2588581 ↗
16. Goyal, V., Mironov, I., Pandey, O., and Sahai, A. (2013, January 18–22). Accuracy-privacy tradeoffs for two-party differentially private protocols. Proceedings of the 33rd Annual Cryptology Conference, Santa Barbara, CA, USA.10.1007/978-3-642-40041-4_17 ↗
17. Kasiviswanathan, S.P., Lee, H.K., Nissim, K., Raskhodnikova, S., and Smith, A. (2008, January 25–28). What can we learn privately?. Proceedings of the 49th Annual IEEE Symposium on Foundations of Computer Science, Philadelphia, PA, USA.10.1109/FOCS.2008.27 ↗
18. Dwork, C., Rothblum, G.N., and Vadhan, S. (2010, January 23–26). Boosting and differential privacy. Proceedings of the 51th Annual IEEE Symposium on Foundations of Computer Science, Las Vegas, NV, USA.10.1109/FOCS.2010.12 ↗
19. Dynamic differential privacy for ADMM-based distributed classification learning10.1109/TIFS.2016.2607691 ↗
20. On differentially private frequent itemset mining10.14778/2428536.2428539 ↗
21. Collaborative search log sanitization: Toward differential privacy and boosted utility10.1109/TDSC.2014.2369034 ↗
22. Differential privacy for Bayesian inference through posterior sampling
23. Differential private data collection and analysis based on randomized multiple dummies for untrusted mobile crowdsensing10.1109/TIFS.2016.2632069 ↗
24. The geometry of differential privacy: The small database and approximate cases10.1137/130938943 ↗
25. Differentially private histogram publication10.1007/s00778-013-0309-y ↗
26. Local differential perturbations: Location privacy under approximate knowledge attackers10.1109/TMC.2012.208 ↗
27. Differentially private graph-link analysis based social recommendation10.1016/j.ins.2018.06.054 ↗
28. Fan, L., Bonomi, L., Xiong, L., and Sunderam, V. (2014, January 7–11). Monitoring web browsing behavior with differential privacy. Proceedings of the 23th International World Wide Web Conference, Seoul, Korea.10.1145/2566486.2568038 ↗
29. A distortion-based approach to privacy-preserving metering in smart grids10.1109/ACCESS.2013.2260815 ↗
30. Jin, X., Zhang, R., Chen, Y., and Zhang, Y. (2016, January 24–28). DPSense: Differentially private crowdsourced spectrum sensing. Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security, Vienna, Austria.10.1145/2976749.2978426 ↗
31. Huang, Z., and Kannan, S. (2012, January 20–23). The exponential mechanism for social welfare: Private, truthful, and nearly optimal. Proceedings of the 53th Annual IEEE Symposium on Foundations of Computer Science, New Brunswick, NJ, USA.10.1109/FOCS.2012.36 ↗
32. Katz, J., and Lindell, Y. (2014). Introduction to Modern Cryptography, CRC Press. [2nd ed.].10.1201/b17668 ↗
33. Universally utility-maximizing privacy mechanisms10.1137/09076828X ↗
34. Xiao, X., Bender, G., Hay, M., and Gehrke, J. (2011, January 12–16). iReduct: Differential privacy with reduced relative errors. Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data, Athens, Greece.10.1145/1989323.1989348 ↗
35. Tossou, A.C.Y., and Dimitrakakis, C. (2016, January 12–17). Algorithms for differentially private multi-armed bandits. Proceedings of the 30th AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.10.1609/aaai.v30i1.10212 ↗
36. Dodis, Y., López-Alt, A., Mironov, I., and Vadhan, S. (2012, January 19–23). Differential privacy with imperfect randomness. Proceedings of the 32th Annual Cryptology Conference, Santa Barbara, CA, USA.10.1007/978-3-642-32009-5_29 ↗
37. Tramèr, F., Huang, Z., Hubaux, J.P., and Ayday, E. (2015, January 12–16). Differential privacy with bounded priors: Reconciling utility and privacy in genome-wide association studies. Proceedings of the 22th ACM SIGSAC Conference on Computer and Communications Security, Denver, CO, USA.10.1145/2810103.2813610 ↗
38. Utility-privacy tradeoffs in databases: An information-theoretic approach10.1109/TIFS.2013.2253320 ↗
39. Geumlek, J., Song, S., and Chaudhuri, K. (2017, January 4–9). Renyi differential privacy mechanisms for posterior sampling. Proceedings of the 31th Annual Conference on Neural Information Processing Systems, Long Beach, CA, USA.
40. Song, S., Wang, Y., and Chaudhuri, K. (2017, January 14–19). Pufferfish privacy mechanisms for correlated data. Proceedings of the 2017 ACM SIGMOD International Conference on Management of Data, Chicago, IL, USA.10.1145/3035918.3064025 ↗
41. Kairouz, P., Oh, S., and Viswanath, P. (2015, January 7–12). Secure multi-party differential privacy. Proceedings of the 29th Annual Conference on Neural Information Processing Systems, Montreal, QC, Canada.
42. Extremal mechanisms for local differential privacy
43. Kairouz, P., Bonawitz, K., and Ramage, D. (2016, January 19–24). Discrete distribution estimation under local privacy. Proceedings of the 33th International Conference on Machine Learning, New York, NY, USA.
44. Differentially private empirical risk minimization
45. Iyer, A.S., Nath, J.S., and Sarawagi, S. (2016, January 13–17). Privacy-preserving class ratio estimation. Proceedings of the 22th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939806 ↗
46. Shokri, R., and Shmatikov, V. (2015, January 12–16). Privacy-preserving deep learning. Proceedings of the 22th ACM SIGSAC Conference on Computer and Communications Security, Denver, CO, USA.10.1145/2810103.2813687 ↗
47. Bernstein, G., McKenna, R., Sun, T., Sheldon, D., Hay, M., and Miklau, G. (2017, January 6–11). Differentially private learning of undirected graphical models using collective graphical models. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia.
48. Friedman, A., and Schuster, A. (2010, January 25–28). Data mining with differential privacy. Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.10.1145/1835804.1835868 ↗
49. Differentially private frequent sequence mining10.1109/TKDE.2016.2601106 ↗
50. Feild, H.A., Allan, J., and Glatt, J. (2011, January 25–29). CrowdLogging: Distributed, private, and anonymous search logging. In Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, Beijing, China.10.1145/2009916.2009969 ↗
51. Korolova, A., Kenthapadi, K., Mishra, N., and Ntoulas, A. (2009, January 20–24). Releasing search queries and clicks privately. Proceedings of the 18th International Conference on World Wide Web, Madrid, Spain.10.1145/1526709.1526733 ↗
52. Zhang, S., Yang, H., and Singh, L. (2016, January 17–21). Anonymizing query logs by differential privacy. Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, Pisa, Italy.10.1145/2911451.2914732 ↗
53. A semantic-preserving differentially private method for releasing query logs
54. A near-optimal algorithm for differentially-private principal components
55. Balle, B., Gomrokchi, M., and Precup, D. (2016, January 19–24). Differentially private policy evaluation. Proceedings of the 33th International Conference on Machine Learning, New York, NY, USA.
56. Zhang, Z., Rubinstein, B.I.P., and Dimitrakakis, C. (2016, January 12–17). On the differential privacy of Bayesian inference. Proceedings of the 30th AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.10.1609/aaai.v30i1.10254 ↗
57. Pathak, M., Rane, S., and Raj, B. (2010, January 6–9). Multiparty differential privacy via aggregation of locally trained classifiers. Proceedings of the 24th Annual Conference on Neural Information Processing Systems, Vancouver, BC, Canada.
58. The optimal noise-adding mechanism in differential privacy10.1109/TIT.2015.2504967 ↗
59. Enhancing social network privacy with accumulated non-zero prior knowledge10.1016/j.ins.2018.02.031 ↗
60. Dppro: Differentially private high-dimensional data release via random projection10.1109/TIFS.2017.2737966 ↗
61. Chen, R., Li, H., Qin, A.K., Kasiviswanathan, S.P., and Jin, H. (2016, January 16–20). Private spatial data aggregation in the local setting. Proceedings of the 32th IEEE International Conference on Data Engineering, Helsinki, Finland.10.1109/ICDE.2016.7498248 ↗
62. McSherry, F., and Mironov, I. (July, January 28). Differentially private recommender systems: Building privacy into the netflix prize contenders. Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Paris, France.
63. Optimal differentially private mechanisms for randomised response10.1109/TIFS.2017.2718487 ↗
64. Ushakov, N.G. (1999). Selected Topics in Characteristic Functions, VSP.10.1515/9783110935981 ↗
65. Hung, P.K. (2008). Secrets in Inequalities, GIL Publishing House.