SmartCrawler: A Three-Stage Ranking Based Web Crawler for Harvesting Hidden Web Sources
Source abstract
Abstract
Web crawlers have evolved from performing a meagre task of collecting statistics, security testing, web indexing and numerous other examples. The size and dynamism of the web are making crawling an interesting and challenging... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Web Data Mining and Analysis · Spam and Phishing Detection · Advanced Malware Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (14)
Show source-provided references
1. Design of an ontology based adaptive crawler for hidden web
2. Prequery discovery of domain-specific query forms: A survey10.1109/TKDE.2012.111 ↗
3. Harnessing the deep web: Present and future
4. Crawling deep web entity pages10.1145/2433396.2433442 ↗
5. Searching for hidden-web databases
6. E-FFC: An enhanced form-focused crawler for domain-specific deep web databases10.1007/s10844-012-0221-8 ↗
7. Crawling the hidden web
8. An adaptive crawler for locating hiddenwebentry points
9. Probe, count, and classify10.1145/376284.375671 ↗
10. Accessing deep web using automatic query translation technique
11. Siphoning hidden-web data through keyword-based interfaces
12. SSIMHAR-Smart distributed web crawler for the hidden web using SIM + hash and redis server10.1109/ACCESS.2020.3004756 ↗
13. Structured databases on the web: Observations and implications10.1145/1031570.1031584 ↗
14. Downloading textual hidden web content through keyword queries