What is crawling and indexing?

Crawling:

  • This involves scanning sites And collecting detail about each page
  • Crawling is a process by which search engine spiders scan a websites and collect details about each page :titles,images,keywords,other linked pages etc
  • eg:Title,image,keyword  and other linked pages
  • It is uses to index webpages in one second 
  • Crawler visit there websites,they use links on those sites to discover other pages

crawling and indexing
crawling and indexing

Indexing:
  • After crawling is done the data is placed in database that is called indexing
  • In simple words,processing of content of the web pages which search engine gets from crawling is called search engine indexing
  • Indexing is next step after crawling which google and other search engines take note of key signals from keywords to website freshness and we keep track of it all in the search index

Comments