Enhancing Food Ingredient Named-Entity Recognition with Recurrent Network-Based Ensemble (RNE) Model
Source abstract
Abstract
Food recipe sharing sites are becoming increasingly popular among people who want to learn how to cook or plan their menu. Through online food recipes, individuals can select ingredients that suit their lifestyle and health condition. Information from online food recipes is useful in developing food-related systems such as recommendations and health care systems. However, the information from online recipes is often unstructured. One way of extracting such information into a well-structured format is the technique called named-entity recognition (NER), which is the process of identifying keywords and phrases in the text and classifying them into a set of predetermined categories, such as location, persons, time, and others. We present a food ingredient named-entity recognition model called RNE (recurrent network-based ensemble methods) to extract the entities from the online recipe. RNE is an ensemble-learning framework using recurrent network models such as RNN, GRU, and LSTM. These models are trained independently on the same dataset and combined to produce better predictions in extracting food entities such as ingredient names, products, units, quantities, and states for each ingredient in a recipe. The experimental findings demonstrate that the proposed model achieves predictions with an F1 score of 96.09% and outperforms all individual models by 0.2% to 0.5% in percentage points. This result indicates that RNE can extract information from food recipes better than a single model. In addition, this information extracted by RNE can be used to support various information systems related to food.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Text Analysis Techniques · Text and Document Classification Technologies · Topic Modeling
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of AI Convergence, Pukyong National University, Busan 48513, Korea
Division of Computer Engineering, Pukyong National University, Busan 48513, Korea
Funding
Ministry of Oceans and Fisheries, Republic of Korea
References (64)
Show source-provided references
1. Syed, M.H., and Chung, S.-T. (2021). MenuNER: Domain-Adapted BERT Based NER Approach for a Domain with Limited Dataset and Its Application to Food Menu Domain. Appl. Sci., 11.10.3390/app11136007 ↗
2. Komariah, K.S., and Sin, B.-K. (2021, January 21–23). Nutrition-Based Food Recommendation System for Prediabetic Person. Proceedings of the 2020 Korea Software Congress, Pyeongchang, Korea.
3. Kalra, J.S., Batra, D., Diwan, N., and Bagler, G. (2020, January 20–24). Nutritional Profile Estimation in Cooking Recipes. Proceedings of the 2020 IEEE 36th International Conference on Data Engineering Workshops (ICDEW), Dallas, TX, USA.10.1109/ICDEW49219.2020.000-3 ↗
4. Pellegrini, C., Özsoy, E., Wintergerst, M., and Groh, G. (2021, January 11–13). Exploiting Food Embeddings for Ingredient Substitution. Proceedings of the HEALTHINF, Online.10.5220/0010202000670077 ↗
5. A Survey of Named-Entity Recognition Methods for Food Information Extraction10.1109/ACCESS.2020.2973502 ↗
6. Krishnan, V., and Ganapathy, V. (2021, February 04). Named Entity Recognition. Available online: http://cs229.stanford.edu/proj2005/KrishnanGanapathy-NamedEntityRecognition.pdf.
7. A Survey on Named Entity Recognition10.1007/978-981-13-9409-6_218 ↗
8. A Survey on Deep Learning for Named Entity Recognition10.1109/TKDE.2020.2981314 ↗
9. Ensemble Learning for Named Entity Recognition10.1007/978-3-319-11964-9_33 ↗
10. Weighted Vote-Based Classifier Ensemble for Named Entity Recognition: A Genetic Algorithm-Based Approach10.1145/1967293.1967296 ↗
11. A Novel Ensemble Method for Named Entity Recognition and Disambiguation Based on Neural Network10.1007/978-3-030-00671-6_6 ↗
12. Biomedical Named Entity Recognition Based on Classifiers Ensemble
13. Ensemble Named Entity Recognition (NER): Evaluating NER Tools in the Identification of Place Names in Historical Corpora10.3389/fdigh.2018.00002 ↗
14. Ensemble of Deep Masked Language Models for Effective Named Entity Recognition in Health and Life Science Corpora10.3389/frma.2021.689803 ↗
15. Nayel, H., and Shashirekha, H.L. (2017, January 18–21). Improving NER for Clinical Texts by Ensemble Approach Using Segment Representations. Proceedings of the 14th International Conference on Natural Language Processing (ICON-2017), Kolkata, India.
16. Copara, J., Naderi, N., Knafou, J., Ruch, P., and Teodoro, D. (2020). Named Entity Recognition in Chemical Patents Using Ensemble of Contextual Language Models. arXiv.
17. Jiang, Z. (2020, January 25–27). The Application of Ensemble Learning on Named Entity Recognition for Legal Knowledgebase of Properties Involved in Criminal Cases. Proceedings of the 2020 IEEE International Conference on Advances in Electrical Engineering and Computer Applications (AEECA), Dalian, China.10.1109/AEECA49918.2020.9213660 ↗
18. Yadav, V., and Bethard, S. (2018, January 21–25). A Survey on Recent Advances in Named Entity Recognition from Deep Learning Models. Proceedings of the 27th International Conference on Computational Linguistics, Association for Computational Linguistics, Santa Fe, NM, USA.
19. Named Entity Recognition with Bidirectional LSTM-CNNs10.1162/tacl_a_00104 ↗
20. End-to-End Sequence Labeling via Bi-Directional LSTM-CNNs-CRF10.18653/v1/P16-1101 ↗
21. Bidirectional Recurrent Neural Networks10.1109/78.650093 ↗
22. Aggarwal, C.C. (2014). Data Classification: Algorithms and Applications, CRC Press.10.1201/b17320 ↗
23. Popovski, G., Kochev, S., Seljak, B., and Eftimov, T. (2019). FoodIE: A Rule-Based Named-Entity Recognition Method for Food Information Extraction. Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods, SCITEPRESS—Science and Technology Publications.10.5220/0007686309150922 ↗
24. Eftimov, T., Koroušić Seljak, B., and Korošec, P. (2017). A Rule-Based Named-Entity Recognition Method for Knowledge Extraction of Evidence-Based Dietary Recommendations. PLoS ONE, 12.10.1371/journal.pone.0179488 ↗
25. Diwan, N., Batra, D., and Bagler, G. (2020, January 20–24). A Named Entity Based Approach to Model Recipes. Proceedings of the 2020 IEEE 36th International Conference on Data Engineering Workshops (ICDEW), Dallas, TX, USA.10.1109/ICDEW49219.2020.000-2 ↗
26. FoodBase Corpus: A New Resource of Annotated Food Entities10.1093/database/baz121 ↗
27. Cenikj, G., Popovski, G., Stojanov, R., Seljak, B.K., and Eftimov, T. (2020, January 10–13). BuTTER: BidirecTional LSTM for Food Named-Entity Recognition. Proceedings of the 2020 IEEE International Conference on Big Data (Big Data), Atlanta, GA, USA.10.1109/BigData50022.2020.9378151 ↗
28. A Fine-Tuned Bidirectional Encoder Representations from Transformers Model for Food Named-Entity Recognition: Algorithm Development and Validation10.2196/28229 ↗
29. Recent Trends in Deep Learning Based Natural Language Processing
30. Huang, Z., Xu, W., and Yu, K. (2015). Bidirectional LSTM-CRF Models for Sequence Tagging. arXiv.
31. Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., and Dyer, C. (2016). Neural Architectures for Named Entity Recognition. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics.10.18653/v1/N16-1030 ↗
32. Panchendrarajan, R., and Amaresan, A. (2018, January 1–3). Bidirectional LSTM-CRF for Named Entity Recognition. Proceedings of the 32nd Pacific Asia Conference on Language, Information and Computation, Hong Kong, China.
33. Goyal, A., Gupta, V., and Kumar, M. (2021). Recurrent Neural Network-Based Model for Named Entity Recognition with Improved Word Embeddings. IETE J. Res., 1–7.10.1080/03772063.2021.2006805 ↗
34. Stock Prediction Based on Optimized LSTM and GRU Models
35. Banik, N., and Rahman, M.H.H. (2018). GRU Based Named Entity Recognition System for Bangla Online Newspapers. Proceedings of the 2018 International Conference on Innovation in Engineering and Technology (ICIET), IEEE.10.1109/CIET.2018.8660795 ↗
36. Yan, S., Chai, J., and Wu, L. (2020, January 12–14). Bidirectional GRU with Multi-Head Attention for Chinese NER. Proceedings of the 2020 IEEE 5th Information Technology and Mechatronics Engineering Conference (ITOEC), Chongqing, China.10.1109/ITOEC49072.2020.9141551 ↗
37. Yang, Z., Salakhutdinov, R., and Cohen, W.W. (2016). Multi-Task Cross-Lingual Sequence Tagging from Scratch. arXiv.
38. Soltau, H., Shafran, I., Wang, M., and Shafey, L.E. (2022). RNN Transducers for Nested Named Entity Recognition with Constraints on Alignment for Long Sequences. arXiv.10.21437/Interspeech.2022-391 ↗
39. Chowdhury, S., Dong, X., Qian, L., Li, X., Guan, Y., Yang, J., and Yu, Q. (2018). A Multitask Bi-Directional RNN Model for Named Entity Recognition on Chinese Electronic Medical Records. BMC Bioinform., 19.10.1186/s12859-018-2467-9 ↗
40. Maclin, R., and Opitz, D.W. (2011). Popular Ensemble Methods: An Empirical Study. arXiv.
41. Dietterich, T.G. (2000). Ensemble Methods in Machine Learning. Multiple Classifier Systems, Springer. MCS 2000. Lecture Notes in Computer Science.10.1007/3-540-45014-9_1 ↗
42. Sarkar, D., and Natarajan, V. (2019). Ensemble Machine Learning Cookbook: Over 35 Practical Recipes to Explore Ensemble Machine Learning Techniques Using Python, Packt.
43. Zhou, Z.-H. (2012). Ensemble Methods: Foundations and Algorithms, Taylor & Francis.10.1201/b12207 ↗
44. (2021, September 10). Allrecipes. Available online: https://www.allrecipes.com/.
45. (2022, March 05). SpaCy. Available online: https://spacy.io/.
46. Loper, E., and Bird, S. (2002). NLTK: The Natural Language Toolkit. arXiv.10.3115/1118108.1118117 ↗
47. (2022, March 05). Doccano: Text Annotation Tool for Human. Available online: https://github.com/doccano/doccano.
48. Boushehri, S.S., Qasim, A.B., Waibel, D., Schmich, F., and Marr, C. (2020). Annotation-Efficient Classification Combining Active Learning, Pre-Training and Semi-Supervised Learning for Biomedical Images. bioRxiv, 414235.
49. Text Chunking Using Transformation-Based Learning10.1007/978-94-017-2390-9_10 ↗
50. (2022, May 03). Understanding LSTM Networks—Colah’s Blog. Available online: http://colah.github.io/posts/2015-08-Understanding-LSTMs/.
51. An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories10.1162/neco.1990.2.4.490 ↗
52. Learning Long-Term Dependencies with Gradient Descent Is Difficult10.1109/72.279181 ↗
53. Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014). Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. arXiv.
54. Cho, K., van Merrienboer, B., Bahdanau, D., and Bengio, Y. (2014). On the Properties of Neural Machine Translation: Encoder–Decoder Approaches. Proceedings of the SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation, Association for Computational Linguistics.10.3115/v1/W14-4012 ↗
55. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
56. Driver Sleepiness Detection Using LSTM Neural Network10.1007/978-3-030-04212-7_55 ↗
57. Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014). Learning Phrase Representations Using RNN Encoder–Decoder for Statistical Machine Translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Association for Computational Linguistics.10.3115/v1/D14-1179 ↗
58. Wisdom of Crowds Cluster Ensemble10.3233/IDA-150728 ↗
59. Oza, N.C., and Russell, S. (2001). Online Ensemble Learning. [Ph.D. Thesis, University of California].
60. Pennington, J., Socher, R., and Maning, C.D. (2022, May 03). GloVe: Global Vectors for Word Representation. Available online: https://nlp.stanford.edu/projects/glove/.
61. A Systematic Analysis of Performance Measures for Classification Tasks10.1016/j.ipm.2009.03.002 ↗
62. Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers
63. A Theoretical and Experimental Analysis of Linear Combiners for Multiple Classifier Systems10.1109/TPAMI.2005.109 ↗
64. Komariah, K.S., Sin, B.-K., and Purnomo, A.T. (2022, May 05). FINER: Food Ingredient NER Dataset (Version 3). Figshare. Available online: https://doi.org/10.6084/m9.figshare.20222361.v3.