Share:

Glossary / Lexicon

What is a crawling infrastructure?

12/06/2022 | by Patrick Fischer, M.Sc., Founder & Data Scientist: FDS
A crawling infrastructure is a system that enables automatic crawling and indexing of web pages. It consists of a set of components that control, collect, and store the process of crawling. These include crawlers, indexers, repositories and managers. It is used to collect, store and index web documents for later use in searching for information.
Like (0)
Comment

Our offer to you:

Media & PR Database 2024

Only for a short time at a special price: The media and PR database with 2024 with information on more than 21,000 newspaper, magazine and radio editorial offices and much more.

Newsletter

Subscribe to our newsletter and receive the latest news & information on promotions: