Accession Number:

ADA517816

Title:

Of Ivory and Smurfs: Loxodontan MapReduce Experiments for Web Search

Descriptive Note:

Conference paper

Corporate Author:

MARYLAND UNIV COLLEGE PARK DEPT OF COMPUTER SCIENCE

Report Date:

2009-11-01

Pagination or Media Count:

11.0

Abstract:

This paper describes Ivory, an attempt to build a distributed retrieval system around the open-source Hadoop implementation of MapReduce. We focus on three noteworthy aspects of our work a retrieval architecture built directly on the Hadoop Distributed File System HDFS, a scalable Map-Reduce algorithm for inverted indexing, and webpage classification to enhance retrieval effectiveness.

Subject Categories:

  • Computer Programming and Software
  • Computer Systems
  • Cybernetics

Distribution Statement:

APPROVED FOR PUBLIC RELEASE