Google hires thousands of people to manually rank search results

Google's search results aren't the magic of algorithms, instead, thousands of people rank them manua.

46 seconds read time

If you ever thought that Google just waved their fingers and had magical algorithms working their search results, you'd be flat out wrong. The Register has opened up the Google 160-page guidebook, which is a reference manual for human "raters".

Google hires thousands of people to manually rank search results |

This has revealed that there's a big human involvement in the results provided by Google when a user runs a search. Google actually outsource to a few different crowdsourcing agencies - Lionbridge and Leapforce, where they use real people and their real-life opinions on search results. The Register refers to one Leapforce job ad, where they employ around 1500 search assessors which is a great work-from-home job.

Before landing this glorious work-from-home job, a potential employee must first pass an initial examination. After this, search assessors will receive periodic Google evaluations to ensure they're doing a standup job on grading search results. The 160-page manual also informs raters about how to rank search results basic on multiple metrics, such as quality, relevance and spamminess. Google's search assessors will judge the results for various queries and choose from different tiered grades, including "Not Spam", "Maybe Spam", "Porn", "Off-Topic", "Unratable", "Vital" and more.


Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags