BWW Geeks World

Twitter Improves Search with Real-Time Human Computation

Related: Twitter
Twitter Improves Search with Real-Time Human Computation

Twitter's Engineering blog has just released details on a new human computation engine that's now in play on the popular micro-blogging site.

"So an event happens, people instantly come to Twitter to search for the event, and we need to teach our systems what these queries mean as quickly as we can - because in just a few hours, the search spike will be gone.

How do we do this? We've built a real-time human computation engine to help us identify search queries as soon as they're trending, send these queries to real humans to be judged, and then incorporate the human annotations into our back-end models.

Overview

Before we delve into the details, here's an overview of how the system works.

  1. First, we monitor for which search queries are currently popular.
    Behind the scenes: we run a Storm topology that tracks statistics on search queries.
    For example, the query [Big Bird] may suddenly see a spike in searches from the US.

  2. As soon as we discover a new popular search query, we send it to our human evaluators, who are asked a variety of questions about the query.
    Behind the scenes: when the Storm topology detects that a query has reached sufficient popularity, it connects to a Thrift API that dispatches the query to Amazon's Mechanical Turk service, and then polls Mechanical Turk for a response.
    For example: as soon as we notice "Big Bird" spiking, we may ask judges on Mechanical Turk to categorize the query, or provide other information (e.g., whether there are likely to be interesting pictures of the query, or whether the query is about a person or an event) that helps us serve relevant Tweets and ads.

  3. Finally, after a response from an evaluator is received, we push the information to our backend systems, so that the next time a user searches for a query, our machine learning models will make use of the additional information. For example, suppose our evaluators tell us that [Big Bird] is related to politics; the next time someone performs this search, we know to surface ads by @barackobama or @mittromney, not ads about Dora the Explorer."

Click here for the full details.

GEEKS VIDEOS

STAGE TUBE: First Look at Second Episode of Telltale's GAME OF THRONESSTAGE TUBE: First Look at Second Episode of Telltale's GAME OF THRONES VIDEO: Watch President Obama's 2015 State of the Union Speech - LIVE!VIDEO: Watch President Obama's 2015 State of the Union Speech - LIVE! Video: YouTube Stars to Interview President Obama - And You Can Too!Video: YouTube Stars to Interview President Obama - And You Can Too! VIDEO: ELLEN Responds to Accusations of Having 'Gay Agenda'VIDEO: ELLEN Responds to Accusations of Having 'Gay Agenda' VIDEO: Google Jumping More into Education with Google ClassroomVIDEO: Google Jumping More into Education with Google Classroom VIDEO: Nintendo Shows Off New Nintendo 3DS XLVIDEO: Nintendo Shows Off New Nintendo 3DS XL VIDEO: Space Ship? No. D-Link Unveils ULTRA Performance Series of 11AC RoutersVIDEO: Space Ship? No. D-Link Unveils ULTRA Performance Series of 11AC Routers Video: D-Link Launches Industry's First Gigabit PowerLine Kits with MIMOVideo: D-Link Launches Industry's First Gigabit PowerLine Kits with MIMO VIDEO: LaCie Unveils Mirror Portable Hard Drive; Encased in Glass & Designed for LooksVIDEO: LaCie Unveils Mirror Portable Hard Drive; Encased in Glass & Designed for Looks VIDEO: Sneak Peek at the Angry Birds Christmas Special SANTAMENTAL MEVIDEO: Sneak Peek at the Angry Birds Christmas Special SANTAMENTAL ME STAGE TUBE: Samsung Canada Celebrates Launch of the NX1 with Short Film Starring Joseph Gordon LevittSTAGE TUBE: Samsung Canada Celebrates Launch of the NX1 with Short Film Starring Joseph Gordon Levitt VIDEO: Aidy Bryant Reaches 10,000 Tweets from Cut Sketch from Last Week's SNL; Watch Below!VIDEO: Aidy Bryant Reaches 10,000 Tweets from Cut Sketch from Last Week's SNL; Watch Below! Fully Restored Video: Craigslist 1996 Nissan Maxima CompletedFully Restored Video: Craigslist 1996 Nissan Maxima Completed VIDEO: CONAN Meets Digitzed Kevin Spacey in 'Call Of Duty: Advanced Warfare'VIDEO: CONAN Meets Digitzed Kevin Spacey in 'Call Of Duty: Advanced Warfare' VIDEO: It's Here! Starwood's Keyless Entry Launches Today!VIDEO: It's Here! Starwood's Keyless Entry Launches Today! New Video: Immigration Enforcement Needed to Counter Criminal and Terrorist ThreatsNew Video: Immigration Enforcement Needed to Counter Criminal and Terrorist Threats

Subscribe for News & Specials