Accession Number:

AD1004395

Title:

A Scalable, Open Source Platform for Data Processing, Archiving and Dissemination

Descriptive Note:

Technical Report,01 Nov 2012,30 Nov 2014

Corporate Author:

MDA Information Systems LLC Gaithersburg United States

Personal Author(s):

• Park,Samuel
• Mattmann,Chris
• Gill,Yolanda

Report Date:

2016-01-01

Pagination or Media Count:

45.0

Abstract:

Building on the Object Oriented Data Technology OODT big data toolkit developed by NASA and the Work-flow INstance Generation and Selection WINGS scientific work-flow system developed by the Information Sciences Institute at the University of Southern California, we focused analytics and work-flows appropriate to several challenge big data problems and demonstrated the utility of OODT-WINGS in addressing them. Specific demonstrated analyses address i crawling and indexing the XNET contents in a quick-reaction demonstration in January 2013, ii a data triage characterization of the Kiva loan system, iii contributory work done on 5 of 6 XDATA summer 2013 workshop challenge problems, and iv demonstration of end-to-end processing work-flow in conjunction with the USC Institute for Creative Technologies end-user interface at the September 2013 DARPA open house. Two papers published during this time addressed i the overall data triage use case, and II work flow characterization during time-bounded operations.

Descriptors:

• DATA PROCESSING
• LEARNING MACHINES
• SEMANTICS
• computer programs
• INFORMATION SYSTEMS
• DATA STORAGE SYSTEMS

Subject Categories:

Distribution Statement:

APPROVED FOR PUBLIC RELEASE