This indexing is done by a software program called spiders, spiders
start by fetching a few web pages and they follow the links on those
pages and fetch the new web page they just found. This process
continues to bring new web page and web content in index of Google.
As you know, internet has got many billions of websites and they all
are talking about different things in different languages.
Maintaining an index of all known websites is a huge task and Google
does that by creating several layers of indexes.
If we assume that there is a layer “A” open for public search,
another layer “B” that is kind of backup and layer “C” that is for
catch.
Indexing software spiders should be interacting with layer “C” and
once they reach the limit of new updated content, another program
governed by ranking algorithm (based on website ranking logic)
starts work for giving a specific point to each page (page value
assignment). Once this process is over, “A” layer updates it self
with layer “C”. Here they must have kind of quality check on this
new updated index, if everything is fine they move to get new
content from the internet. Just incase they find that something went
wrong and results are not correct, they can always update layer “A”
with backup layer “B” to restore old index.
Now, we have to understand the concept of search so we can better
understand how it works.
Google or any responsible search engine wants to show results based
on the demand by the user. Let’s take an example; I want to search
for a local SEO company in Bangalore. What should I search for?
I will open google.com and will search for “seo company in
Bangalore”, is not it? Now Google will look for all the pages
available in its layer “A” where there is word “SEO Company in
Bangalore”, they will check the quality, page rank and other
relevant check lists associates with this search term and show me a
list of websites shorted in a relevancy order.
A search result takes about half a second but in this half second,
software programs do check billions of pages, run hundreds of
quality checks before producing the actual result.
These software programs are fast and smart, and they need to be
updated continually to fight with ever growing leg pullers.
I am going to explain this in detail with examples, stay tuned…
--
Article by Abhishek
For any enquiries, comments write to abhishek@indian-seo.com
Indian SEO, SEO
Company based in Bangalore, India