A Specialized Data Crawler for Urban Wood Information
Source abstract
Abstract
Abstract The Internet is composed of >50 billion Web pages and grows larger every day. As the number of links and specialty subject areas increases, it becomes ever more difficult to find pertinent information. For some subject areas, special purpose data crawlers continually search the Internet for specific information; examples include real estate, air travel, auto sales, and others. The use of such special purpose data crawlers (i.e., targeted crawlers and knowledge databases), also allows the collection and analysis of agricultural and forestry data. Such single-purpose crawlers can search for hundreds of keywords and use machine learning to determine whether or not what is found is relevant. In this paper, we examine the design and data return of such a specialty knowledge database and crawler system developed to find information related to urban wood utilization—products made from timber harvested in cities and municipalities. Our search engine uses intelligent software to locate and update pertinent references related to urban wood as well as to categorize information with respect to common application and interest areas. At the time of this publication, the urban wood knowledge database has cataloged >700 publications regarding various aspects of urban wood.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Horticultural and Viticultural Research · Fermentation and Sensory Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (17)
Show source-provided references
1. Albani, S., Lazzarini M., Koubarakis M., Taniskidou E., Papadakis G., Karkaletsis V., and GiannakopoulosG. 2016. A pilot for big data exploration in the space and security domain. In:Proceedings of 2016 Conference on Big Data from Space (BiDS'16), SoilleP. and MarchettiP. G. (Eds.). Publications Office of the European Union. 4 pp. http://publications.jrc.ec.europa.eu/repository/handle/JRC100655. DOI: 10.2788/854791. Accessed October 31, 2023.
2. Apache Software Foundation . 2022a. Apache HttpCore Overview. https://hc.apache.org/httpcomponents-core-4.4.x/index.html/. Accessed July 27, 2022.
3. Apache Software Foundation. 2022b. Apache Tika—A Content Analysis Toolkit. Apache Software Foundation. https://tika.apache.org/. Accessed July 27, 2022.
4. de Kunder, M. 2023. Daily estimated size of the World Wide Web. https://www.worldwidewebsize.com/. Accessed April 18, 2023.
5. Frank, E., Hall M. A., and WittenI. H. 2016. The WEKA workbench. Online appendix for: Data Mining: Practical Machine Learning Tools and Techniques. Fourth ed. 2016. Morgan Kaufmann. https://www.cs.waikato.ac.nz/ml/weka/Witten_et_al_2016_appendix.pdf. Accessed Nov 1, 2023.
6. GROBID . 2022. GROBID: GeneRation Of BIbliographic Data. https://github.com/kermitt2/grobid. Accessed July 27, 2022.
7. Heaton, J. 2002. Programming Spiders, Bots, and Aggregators in Java. Sybex Publishing, San Francisco, California. 516 pp.
8. Herdon, M., Burriel C., Tamás J., Várallyai L., Lengyel P., and PancsiraJ. 2014. AgroFE—Collaborative environment and building learning knowledge base for agro–forestry trainings. World Conference on Computers in Agriculture and Natural Resources, University of Costa Rica, San Jose Costa Rica, July 27–30, 2014. Sponsor or publisher name, city, country. # pp. http://CIGRProceedings.org. Accessed Month day, year.
9. Huss, N. 2023. How many websites are there in the world? https://siteefy.com/how-many-websites-are-there/. Accessed April 18, 2023.
10. Medelyan, A. 2018. Python implementation of the Rapid Automatic Keyword Extraction (RAKE) algorithm. https://github.com/zelandiya/RAKE-tutorial. Accessed July 28, 2022.
11. OpenAI . 2023. Pioneering Research. OpenAI, San Francisco, California. https://openai.com/research/overview. Accessed September 14, 2023.
12. Oracle Corp . 2023a. MySQL Enterprise Edition. Oracle Corporation. https://www.mysql.com/products/enterprise/. Accessed April 18, 2023.
13. Oracle Corp . 2023b. Oracle Technology Network for Java Developers. Oracle Corporation. https://docs.oracle.com/en/java/javase/18/index.html. Accessed April 18, 2023.
14. Oumghar, K. 2021. Text-Summarizer. https://github.com/karimo94/Text-Summarizer. Accessed July 27, 2022.
15. Pitti, A., Espinoza O., and SmithR. 2019. Marketing practices in the urban and reclaimed wood industries. Bioprod. Bus. 4(2):15–26. https://doi.org/10.22382/bpb-2019-002
16. Rose, S., Engel D., Cramer N., and CowleyW. 2010. Automatic keyword extraction from individual documents. In:Text Mining: Theory and Applications. BerryM. W. and KoganJ. (Eds.). John Wiley & Sons. https://doi.org/10.1002/9780470689646.ch1
17. Thomas, E., Espinoza O., Bora R., and BuehlmannU. 2020. A specialized data crawler for cross-laminated timber information resources. Forest Prod. J. 70(3):256–261.