Parable of the single sheep - Or How Google is destroying the internet, and nobody seems to know.

This is a parable in two parts. Story and the Moral. If you are in a hurry you might want to skip ahead to the moral (But you miss the beautiful story).

The Story

Long ago was the kingdom of Foobr, a kingdom mostly of shepherds, who grazed their sheep under the benevolent but watchful eyes of their King Oggle. There were all types of shepherds in the kingdom, some had only a few sheep, and some had a few hundreds. The sheep too were of all types and varieties, some gave a ton of wool, and some only a few bales.

What man webmaster of you, having an hundred sheep sites, if he lose one of them gets one penalised, doth not leave the ninety and nine in the wilderness, and go after that which is lost, until he find it?
Luke 15:4

For a long time the kingdom, and its economy based on wool prospered well. It was not a very efficient marketplace, though, as the shepherds who had more sheep grazed more of the common fodder and pastures, and these shepherds got rich. The shepherds who had a single but more productive sheep could only make so much wool!

The king though of himself as hard but fair. “Ah! I need to overcome this inefficiency in my kingdom. I need to reward those who use resources judiciously, and punish those who have a lot of inefficient sheep.” he thought. He asked his Sages to get to work to determine which sheep were inefficient, and needed to be killed! “This will increase the efficiency in my kingdom, and make the kingdom happier overall.”

The sages worked hard, analyzed millions of records and found out that red sheep were less efficient than other sheep. “If we kill all the red sheep, the efficiency of the kingdom will go up by 10% and in two years the production by 5%.” The king was duly impressed and ordered all the red sheep killed. As promised, the efficiency increased by 10% overnight!

****

Ramu was a simple shepherd. He had but one sheep. It was efficient, but as luck would have it red in color. The king’s decree left him without a means of income. “I guess this was my bad luck. I will not buy a red sheep next year, and buy only the most efficient sheep.”

For some reason, unexplained at that time, the quick gains in efficiency were not maintained. “I know, we need to kill the least efficient sheep again.” So the sages went back to their laboratories again, and found that now the pink sheep were the least efficient. The king ordered all pink sheep destroyed. Guess what was the color of Ramu’s sheep?

Ramu was not alone in this misery of his. Many other people, who had but one sheep had their sheep killed, and went to a starving condition. The real culprits, the people who the king wanted to target, the people who had hundreds of sheep, lost many of their sheep as well, but only a percentage of their total sheep. Everyone saw this happening, and even those people who had only one efficient sheep decided to hedge their bets, and started having many inefficient sheep. The more sheep the king killed, the more prudent it became to have many inefficient sheep. In no time efficiency had plummeted, and total production of wool was a fraction of earlier.

The Moral

Spam in webpages is a major problem facing search engines. For long the Search Engines have tried to counter this problem by algorithms in which nobody knows which website will be classified as spam. If the algorithms decides that your website is spam, boo, it is toast.

With Google driving most of the traffic to most sites, no webmaster can afford to have his only source of income depend on Google’s whims. This means that they must hedge their bets against the vagaries of Google’s changing guidelines, and instead of building one kick-ass website must build a large number of websites. Bye-bye engaging content, welcome mediocrity.

For trade to flourish, and for wealth to be made there must be a set of rules which everybody knows, a priory, and if they hold themselves to these rules they must be assured of their safety. This is not the case on the Internet. On the internet, rule of man, not rule of law works. Google is the judge, jury and executioner. This leads to a wild west landscape where webmasters must hedge their bets by having a large number of so-so websites.

In security, for long we have known that “Security through Obscurity” does not work. I postulate that even in fighting spam, “Security through Obscurity” does not work. After all for ten years Search Engines have tried fighting spam though Security through Obscurity, is it not time that we rethink the strategies?

One of the biggest inventions for English society, which allowed their citizens certain inviolable rights, and which allowed them to build a strong society on rule of law, not rule of men was the Magna Carta, which proclaimed,

NO Freeman shall be taken or imprisoned, or be disseised of his Freehold, or Liberties, ... but by lawful judgment of his Peers, or by the Law of the Land....

We need a similar proclamation

No Website shall be taken or penalized, or be relieved of its Ranking, or Traffic, .... but by the lawful judgement of the Law of the Land which are known to all ....

This will give the webmasters the peace of mind to focus their energies on one website, with deep and engaging content instead of making them hedge their bets on many mediocre web site. It will give the peace of mind that they will not be penalized by an ever changing law, which will make some of their tactics shady, and take away their only source of income.

Here is to a better internet.


If you liked this, you might also like Parable of the Captcha or Parable of the Nofollow. The name is of course stolen from Parable of the Lost Sheep

Oh and yes, 42topics is live now. Did you know we have an SEO section, and that you can create a topic about topics you care about?

?

Thank you for reading the Agiliq blog. This article was written by shabda on May 8, 2008 in search .

You can subscribe ⚛ to our blog.

We love building amazing apps for web and mobile for our clients. If you are looking for development help, contact us today ✉.

Would you like to download 10+ free Django and Python books? Get them here