In previous topics, we’ve defined search engine bots as these tiny and awesome secretaries of artificial intelligence, complete with beehive hairdos and pointy-edged glasses. These tiny secretary robots scour the web following the massive flotsam and jetsam of collected content in huge vats of data. From their tireless and spookily exacting meticulousness, they file and store the information until it’s “called up” by a person who has just typed something like “woolen sock knitting guide” into a search field on a search engine somewhere in a house across the planet. In less than two shakes of a lamb’s tail, the information is provided to the user, and woolen sock knitting ensues.
Of course, there are many common mistakes that website owners make, that confuse the process.
Link structures on a site that aren’t made well can stop a search engine from being able to reach the full content of a site. Another glitch is programming that accidentally fools a search engine into thinking that indexing the content is superfluous.
It is not uncommon for the mini secretary robots to be given unclear or garbled directives, so that they are left wandering around the Internet aimless, not busily filing information like they should be doing.