opensource/developer-roadmap
3
0
Fork 0
mirror of https://github.com/kamranahmedse/developer-roadmap.git synced 2026-10-29 17:44:52 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
chore/sync-content-to-repo-python-data-analysis
developer-roadmap/roadmaps/seo/content/crawling--indexing@HyHeVY2JLg9jGedL53baF.md
T

732 B
Raw Permalink Blame History

Crawling & Indexing

Crawling is the process of a bot visiting pages on a website to read their content. Indexing is what happens after crawling, when a search engine stores and organizes that content so it can be retrieved later for relevant searches. A page can be crawled without being indexed, for example if it is judged low quality or duplicate.

Visit the following resources to learn more:

Reference in New Issue View Git Blame Copy Permalink