Google search and search engine spam

Posted by Matt Cutts, Principal Engineer, Google

January 2011 brought a spate of stories about Google's search quality. Reading through some of these recent articles, you might ask whether our search quality has gotten worse. The short answer is that according to the evaluation metrics that Google has refined over more than a decade, Google's search quality is better than it has ever been in terms of relevance, freshness and comprehensiveness. Today, English-language spam in Google's results is less than half what it was five years ago, and spam in most other languages is even lower than in English. However, Google has seen a slight uptick of spam in recent months, and while Google has already made progress, Google has new efforts underway to continue to improve the search quality.

Just as a reminder, webspam is junk you see in search results when websites try to cheat their way into higher positions in search results or otherwise violate search engine quality guidelines. A decade ago, the spam situation was so bad that search engines would regularly return off-topic webspam for many different searches. For the most part, Google has successfully beaten back that type of "pure webspam"-even while some spammers resort to sneakier or even illegal tactics such as hacking websites.

As Google has increased both the size and freshness in recent months, Google has naturally indexed a lot of good content and some spam as well. To respond to that challenge, Google recently launched a redesigned document-level classifier that makes it harder for spammy on-page content to rank highly. The new classifier is better at detecting spam on individual web pages, e.g., repeated spammy words-the sort of phrases you tend to see in junky, automated, self-promoting blog comments. Google has also radically improved our ability to detect hacked sites, which were a major source of spam in 2010. And Google is evaluating multiple changes that should help drive spam levels even lower, including one change that primarily affects sites that copy others' content and sites with low levels of original content. Google will continue to explore ways to reduce spam, including new ways for users to give more explicit feedback about spammy and low-quality sites.

As "pure webspam" has decreased over time, attention has shifted instead to "content farms," which are sites with shallow or low-quality content. In 2010, Google launched two major algorithmic changes focused on low-quality sites. Nonetheless, Google hears the feedback from the web loud and clear: people are asking for even stronger action on content farms and sites that consist primarily of spammy or low-quality content. Google takes pride in Google search and strive to make each and every search perfect. The fact is that Google is not perfect, and combined with users' skyrocketing expectations of Google, these imperfections get magnified in perception. However, Google can and should do better.

One misconception that Google has seen in the last few weeks is the idea that Google doesn't take as strong action on spammy content in our index if those sites are serving Google ads. To be crystal clear:

• Google absolutely takes action on sites that violate our quality guidelines regardless of whether they have ads powered by Google;
• Displaying Google ads does not help a site's rankings in Google; and
• Buying Google ads does not increase a site's rankings in Google's search results.

These principles have always applied, but it's important to affirm they still hold true.

People care enough about Google to tell us-sometimes passionately-what they want to see improved. Google deeply appreciate this feedback. Combined with our own scientific evaluations, user feedback allows us to explore every opportunity for possible improvements. Please tell Google how they can do a better job, and Google will continue to work towards a better Google.

Originally published here