journal article·2022-07-28Open access

Draw-a-Deep Pattern: Drawing Pattern-Based Smartphone User Authentication Based on Temporal Convolutional Neural Network

Junhong Kim, Pilsung Kang

Applied Sciences· Volume 12· Issue 15

Abstract

Present-day smartphones provide various conveniences, owing to high-end hardware specifications and advanced network technology. Consequently, people rely heavily on smartphones for a myriad of daily-life tasks, such as work scheduling, financial transactions, and social networking, which require a strong and robust user authentication mechanism to protect personal data and privacy. In this study, we propose draw-a-deep-pattern (DDP)—a deep learning-based end-to-end smartphone user authentication method using sequential data obtained from drawing a character or freestyle pattern on the smartphone touchscreen. In our model, a recurrent neural network (RNN) and a temporal convolution neural network (TCN), both of which are specialized in sequential data processing, are employed. The main advantages of the proposed DDP are (1) it is robust to the threats to which current authentication systems are vulnerable, e.g., shoulder surfing attack and smudge attack, and (2) it requires few parameters for training; therefore, the model can be consistently updated in real-time, whenever new training data are available. To verify the performance of the DDP model, we collected data from 40 participants in one of the most unfavorable environments possible, wherein all potential intruders know how the authorized users draw the characters or symbols (shape, direction, stroke, etc.) of the drawing pattern used for authentication. Of the two proposed DDP models, the TCN-based model yielded excellent authentication performance with average values of 0.99%, 1.41%, and 1.23% in terms of AUROC, FAR, and FRR, respectively. Furthermore, this model exhibited improved authentication performance and higher computational efficiency than the RNN-based model in most cases. To contribute to the research/industrial communities, we made our dataset publicly available, thereby allowing anyone studying or developing a behavioral biometric-based user authentication system to use our data without any restrictions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: User Authentication and Security Systems · Biometric Identification and Security · Face recognition and analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Industrial & Management Engineering, Korea University, Seoul 02841, Korea

Funding

National Research Foundation of Korea (NRF) · Institute of Information & communications Technology Planning & Evaluation (IITP)

References (38)

Show source-provided references
1. Analyzing International Collaboration and Identifying Core Topics for the “Internet of Things” Based on Network Analysis and Topic Modeling
2. Recent advances in mobile touch screen security authentication methods: A systematic literature review10.1016/j.cose.2019.04.008 ↗
3. Beyond the pin: Enhancing user authentication for mobile devices10.1016/S1361-3723(08)70127-1 ↗
4. Sae-Bae, N., Ahmed, K., Isbister, K., and Memon, N. (2012, January 5–10). Biometric-rich gestures: A novel approach to authentication on multi-touch devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA.10.1145/2207676.2208543 ↗
5. A novel classification-selection approach for the self updating of template-based face recognition systems10.1016/j.patcog.2019.107121 ↗
6. Biometrics: A tool for information security10.1109/TIFS.2006.873653 ↗
7. Enhancing security and privacy in biometrics-based authentication systems10.1147/sj.403.0614 ↗
8. TDAS: A touch dynamics based multi-factor authentication solution for mobile devices10.1108/IJPCC-01-2016-0005 ↗
9. Shahzad, M., Liu, A.X., and Samuel, A. (October, January 30). Secure unlocking of mobile touch screen devices by simple gestures: You can see it but you can not do it. Proceedings of the 19th Annual International Conference on Mobile Computing & Networking, Miami, FL, USA.
10. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv.
11. Accurate recognition of words in scenes without character segmentation using recurrent neural network10.1016/j.patcog.2016.10.016 ↗
12. A study on usability and security features of the android pattern lock screen10.1108/ICS-01-2015-0001 ↗
13. DRAW-A-PIN: Authentication using finger-drawn PIN on touch devices10.1016/j.cose.2017.01.008 ↗
14. Shukla, D., Kumar, R., Serwadda, A., and Phoha, V.V. (2014, January 3–7). Beware, your hands reveal your secrets!. Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security, Scottsdale, AZ, USA.10.1145/2660267.2660360 ↗
15. Smudge Attacks on Smartphone Touch Screens
16. Lindemann, R. (2013). The evolution of authentication. ISSE 2013 Securing Electronic Business Processes, Springer.10.1007/978-3-658-03371-2_2 ↗
17. Jermyn, I., Mayer, A., Monrose, F., Reiter, M.K., and Rubin, A.D. (1999). The Design and Analysis of Graphical Passwords, USENIX Association.
18. Dunphy, P., and Yan, J. (2007, January 28–31). Do background images improve draw a secret graphical passwords?. Proceedings of the 14th ACM Conference on Computer and Communications Security, Alexandria, VA, USA.10.1145/1315245.1315252 ↗
19. Yan, Q., Han, J., Li, Y., Zhou, J., and Deng, R.H. (2013, January 8–10). Designing leakage-resilient password entry on touchscreen mobile devices. Proceedings of the 8th ACM SIGSAC Symposium on Information, Computer and Communications Security, Hangzhou, China.10.1145/2484313.2484318 ↗
20. Analysis of dictionary methods for PIN selection10.1016/j.cose.2013.08.006 ↗
21. Aly, Y., Munteanu, C., Raimondo, S., Wu, A.Y., and Wei, M. (2016, January 6–9). Spin-lock gesture authentication for mobile devices. Proceedings of the 18th International Conference on Human–Computer Interaction with Mobile Devices and Services Adjunct, Florence, Italy.10.1145/2957265.2961863 ↗
22. Secure bimodal PIN-entry method using audio signals10.1016/j.cose.2015.06.006 ↗
23. The biometric menagerie10.1109/TPAMI.2008.291 ↗
24. Gupta, P., Behera, S., Vatsa, M., and Singh, R. (2014, January 24–28). On iris spoofing using print attack. Proceedings of the 2014 22nd International Conference on Pattern Recognition, Stockholm, Sweden.10.1109/ICPR.2014.296 ↗
25. Biometric recognition: Security and privacy concerns10.1109/MSECP.2003.1193209 ↗
26. Feng, T., Liu, Z., Kwon, K.A., Shi, W., Carbunar, B., Jiang, Y., and Nguyen, N. (2012, January 13–15). Continuous mobile authentication using touchscreen gestures. Proceedings of the 2012 IEEE Conference on Technologies for Homeland Security (HST), Waltham, MA, USA.10.1109/THS.2012.6459891 ↗
27. De Luca, A., Hang, A., Brudy, F., Lindner, C., and Hussmann, H. (2012, January 5–10). Touch me once and i know it’s you!: Implicit authentication based on touch screen patterns. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA.10.1145/2207676.2208544 ↗
28. Corpus, K.R., Gonzales, R.J.D., Morada, A.S., and Vea, L.A. (2016, January 14–22). Mobile user identification through authentication using keystroke dynamics and accelerometer biometrics. Proceedings of the 2016 IEEE/ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft), Austin, TX, USA.10.1145/2897073.2897111 ↗
29. Geng, Y., Su, L., Jia, Y., and Han, C. (2019). Seismic Events Prediction Using Deep Temporal Convolution Networks. J. Electr. Comput. Eng.10.1155/2019/7343784 ↗
30. Lea, C., Flynn, M.D., Vidal, R., Reiter, A., and Hager, G.D. (2017, January 21–26). Temporal convolutional networks for action segmentation and detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.113 ↗
31. Ba, J.L., Kiros, J.R., and Hinton, G.E. (2016). Layer normalization. arXiv.
32. Imagenet classification with deep convolutional neural networks
33. Zhang, X., and LeCun, Y. (2017). Which encoding is the best for text classification in chinese, english, japanese and korean?. arXiv.
34. LSTM: A search space odyssey10.1109/TNNLS.2016.2582924 ↗
35. Kim, J., and Kang, P. (2018). Recurrent neural network-based user authentication for freely typed keystroke data. arXiv.
36. Twin support vector regression with Huber loss10.3233/JIFS-16629 ↗
37. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach10.2307/2531595 ↗
38. Regret graphs, diagnostic uncertainty and Youden’s Index10.1002/(SICI)1097-0258(19960530)15:10<969::AID-SIM211>3.0.CO;2-9 ↗