DID YOU KNOW? DTIC has over 3.5 million final reports on DoD funded research, development, test, and evaluation activities available to our registered users. Click
HERE to register or log in.
Accession Number:
AD1004395
Title:
A Scalable, Open Source Platform for Data Processing, Archiving and Dissemination
Descriptive Note:
Technical Report,01 Nov 2012,30 Nov 2014
Corporate Author:
MDA Information Systems LLC Gaithersburg United States
Report Date:
2016-01-01
Pagination or Media Count:
45.0
Abstract:
Building on the Object Oriented Data Technology OODT big data toolkit developed by NASA and the Work-flow INstance Generation and Selection WINGS scientific work-flow system developed by the Information Sciences Institute at the University of Southern California, we focused analytics and work-flows appropriate to several challenge big data problems and demonstrated the utility of OODT-WINGS in addressing them. Specific demonstrated analyses address i crawling and indexing the XNET contents in a quick-reaction demonstration in January 2013, ii a data triage characterization of the Kiva loan system, iii contributory work done on 5 of 6 XDATA summer 2013 workshop challenge problems, and iv demonstration of end-to-end processing work-flow in conjunction with the USC Institute for Creative Technologies end-user interface at the September 2013 DARPA open house. Two papers published during this time addressed i the overall data triage use case, and II work flow characterization during time-bounded operations.
Distribution Statement:
APPROVED FOR PUBLIC RELEASE