slow search.pptx

Slow SearchWith PeopleJaime Teevan, Microsoft Research, ***@jteevanMicrosoft: Kevyn Collins-Thompson, Susan Dumais, Eric Horvitz,Adam Kalai, Ece Kamar,Dan Liebling, Merrie Morris, Ryen WhiteCollaborators: Michael Bernstein, Jin-Woo Jeong, Yubin Kim, Walter Lasecki, Rob Miller, anisciak, Katrina Panovich2Slow Movements3Speed Focus in Search Reasonable4Not All Searches Need to Be Fast?Long-term tasks?Long search sessions?Multi-session searches?Social search?Question asking?Technologically limited?Mobile devices?Limited connectivity?Search from space5Making Use of Additional Time6CrowdsourcingUsing putation to improve ponents with People?Search process?Understand query?Retrieve ?Understand results?Machines are good at operating at scale?People are good at understandingwith Kim, Collins-Thompson8Understand Query: Query Expansion?Original query: hubble telescope achievements?Automatically identify expansion terms:?space, star, astronomy, galaxy, solar,astro, earth, astronomer?Best expansion terms cover multiple aspects of the query?Ask crowd to relate expansion terms to a query term?Identify best expansion terms:?astronomer, astronomy, starspacestarastronomygalaxysolarastroearthastronomerhubble11210001telescope12200001achievements000000019Understand Results: Filtering?Remove irrelevant results from list?Ask crowd workers to vote on relevance?Example: ?hubbletelescope achievements10People Are Not ponents?Test corpora?Difficult Web queries?TREC Web Track queries?Query expansion generally ineffective?Query filtering?Improves quality slightly?Improves robustness?Not worth the time and cost?Need to use people in new ways