Record Linkage of Chinese Patent Inventors and Authors of Scientific Articles
Source abstract
Abstract
We present an algorithm to find corresponding authors of patents and scientific articles. The authors are given as records in Scopus and the Chinese Patents Database. This issue is known as the record linkage problem, defined as finding and linking individual records from separate databases that refer to the same real-world entity. The presented solution is based on a record linkage framework combined with text feature extraction and machine learning techniques. The main challenges were low data quality, lack of common record identifiers, and a limited number of other attributes shared by both data sources. Matching based solely on an exact comparison of authors’ names does not solve the records linking problem because many Chinese authors share the same full name. Moreover, the English spelling of Chinese names is not standardized in the analyzed data. Three ideas on how to extend attribute sets and improve record linkage quality were proposed: (1) fuzzy matching of names, (2) comparison of abstracts of patents and articles, (3) comparison of scientists’ main research areas calculated using all metadata available. The presented solution was evaluated in terms of matching quality and complexity on ≈250,000 record pairs linked by human experts. The results of numerical experiments show that the proposed strategies increase the quality of record linkage compared to typical solutions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Quality and Management · Semantic Web and Ontologies · Biomedical Text Mining and Ontologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Computer Science, Warsaw University of Technology, 00-665 Warsaw, Poland
Shanghai Science and Technology Development Co. Ltd., Shanghai 200233, China
References (42)
Show source-provided references
1. Christen, P. (2012). Data Matching—Concepts and Techniques for Record Linkage, Entity Resolution, and Duplicate Detection, Springer.10.1007/978-3-642-31164-2 ↗
2. Analysis of identifier performance using a deterministic linkage algorithm
3. Validation of a Hierarchical Deterministic Record-Linkage Algorithm Using Data from 2 Different Cohorts of Human Immunodeficiency Virus-Infected Persons and Mortality Databases in Brazil10.1093/aje/kwn249 ↗
4. Validity of deterministic record linkage using multiple indirect personal identifiers10.1161/CIRCOUTCOMES.113.000294 ↗
5. Record linkage software in the public domain: A comparison of link plus, the link king, and a ’basic’ deterministic algorithm10.1177/1460458208088855 ↗
6. A theory for record linkage10.1080/01621459.1969.10501049 ↗
7. Herzog, T.N., Scheuren, F.J., and Winkler, W.E. (2007). Data Quality and Record Linkage Techniques, Springer.
8. Bilenko, M., Kamath, B., and Mooney, R.J. (2006, January 18–22). Adaptive blocking: Learning to scale up record linkage. Proceedings of the Sixth International Conference on Data Mining, Hong Kong, China.10.1109/ICDM.2006.13 ↗
9. Michelson, M., and Knoblock, C.A. (2006, January 16–20). Learning blocking schemes for record linkage. Proceedings of the AAAI, Boston, MA, USA.
10. Quass, D., and Starkey, P. (2003, January 24–27). Record linkage for genealogical databases. Proceedings of the KDD—2003 Workshop on Data Cleaning, Record Linkage, and Object Consolidation, Washington, DC, USA.
11. Wilson, D.R. (August, January 31). Beyond probabilistic record linkage: Using neural networks and complex features to improve genealogical record linkage. Proceedings of the 2011 International Joint Conference on Neural Networks, San Jose, CA, USA.10.1109/IJCNN.2011.6033192 ↗
12. Efficient data reconciliation10.1016/S0020-0255(00)00070-0 ↗
13. Bilenko, M., and Mooney, R.J. (2003, January 24–27). Adaptive duplicate detection using learnable string similarity measures. Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.10.1145/956750.956759 ↗
14. Framework for evaluating clustering algorithms in duplicate detection10.14778/1687627.1687771 ↗
15. Collective entity resolution in relational data10.1145/1217299.1217304 ↗
16. A network analysis model for disambiguation of names in lists10.1007/s10588-005-3940-3 ↗
17. Dong, X., Halevy, A., and Madhavan, J. (2005, January 14–16). Reference reconciliation in complex information spaces. Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, Baltimore, MD, USA.10.1145/1066157.1066168 ↗
18. Domain-independent data cleaning via analysis of entity-relationship graph10.1145/1138394.1138401 ↗
19. Bosch, M., Brauer, M., Burnett, R., Davies, H.W., Davis, Z., Guhn, M., Jarvis, I., Nesbitt, L., Oberlander, T., and Rugel, E. (2018). Born to be wise: A population registry data linkage protocol to assess the impact of modifiable early-life environmental exposures on the health and development of children. BMJ Open, 1–10.
20. Newcombe, H.B. (1988). Handbook of Record Linkage: Methods for Health and Statistical Studies, Administration, and Business, Oxford University Press, Inc.
21. Data Resource Profile: The Rochester Epidemiology Project (REP) medical records-linkage system10.1093/ije/dys195 ↗
22. Porter, E.H., and Winkler, W.E. (1997). Approximate string comparison and its effect on an advanced record linkage system. Advanced Record Linkage System, US Bureau of the Census. Research Report.
23. Homeland insecurity: Datamining, terrorism detection, and confidentiality
24. Is the prominent scientist the one who becomes an inventor? A matching of swedish academic pairs in nanoscience to examine the effect of publishing on patenting10.1093/reseval/rvx004 ↗
25. Pace: A general-purpose tool for authority control
26. Publication and patent behavior of academic researchers: Conflicting, reinforcing or merely co-existing?10.1016/j.respol.2006.02.003 ↗
27. Conrad, C., Ali, N., Kešelj, V., and Gao, Q. (September, January 29). ELM: An extended logic matching method on record linkage analysis of disparate databases for profiling data mining. Proceedings of the IEEE 18th Conference on Business Informatics, Paris, France.
28. Large-scale name disambiguation of chinese patent inventors (1985–2016)10.1007/s11192-019-03310-w ↗
29. The merge/purge problem for large databases10.1145/568271.223807 ↗
30. Monge, A.E., and Elkan, C.P. (1996, January 2–4). The field matching problem: Algorithms and applications. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, Portland, OR, USA.
31. Cohen, W.W., Ravikumar, P., and Fienberg, S.E. (2003, January 9–10). A comparison of string distance metrics for name-matching tasks. Proceedings of the 2003 International Conference on Information Integration on the Web, Acapulco, Mexico.
32. Naumann, F., and Herschel, M. (2010). An introduction to duplicate detection. An Introduction to Duplicate Detection, Morgan & Claypool Publishers.10.1007/978-3-031-01835-0 ↗
33. Bradford, R.B. (2008, January 26–30). An empirical study of required dimensionality for large-scale latent semantic indexing applications. Proceedings of the 17th ACM Conference on Information and Knowledge Management, Napa Valley, CA, USA.10.1145/1458082.1458105 ↗
34. Multilabel neural networks with applications to functional genomics and text categorization10.1109/TKDE.2006.162 ↗
35. Hyperband: A novel bandit-based approach to hyperparameter optimization
36. De Bruin, J. (2021, March 30). Python Record Linkage Toolkit: A Toolkit for Record Linkage and Duplicate Detection in Python. Available online: https://zenodo.org/record/3559043#.YTpbo3UzZaY.
37. Scikit-learn: Machine learning in Python
38. Reback, J., McKinney, W., den Bossche, J.V., Augspurger, T., Cloud, P., Hawkins, S., Klein, A., Roeschke, M., Tratner, J., and She, C. (2020, September 01). Pandas 1.1.1. Available online: https://github.com/pandas-dev/pandas/releases.
39. Daiber, J., Jakob, M., Hokamp, C., and Mendes, P.N. (2013, January 4–6). Improving efficiency and accuracy in multilingual entity extraction. Proceedings of the 9th International Conference on Semantic Systems, Graz, Austria.10.1145/2506182.2506198 ↗
40. Szymański, P., and Kajdanowicz, T. (2017). A scikit-based Python environment for performing multi-label classification. arXiv.
41. Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2–4). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, Savannah, GA, USA.
42. O’Malley, T., Bursztein, E., Long, J., Chollet, F., Jin, H., and Invernizzi, L. (2020, September 01). Keras Tuner. Available online: https://github.com/keras-team/keras-tuner.