A Scalable, Open Source Platform for Data Processing, Archiving and Dissemination
Technical Report,01 Nov 2012,30 Nov 2014
MDA Information Systems LLC Gaithersburg United States
Pagination or Media Count:
Building on the Object Oriented Data Technology OODT big data toolkit developed by NASA and the Work-flow INstance Generation and Selection WINGS scientific work-flow system developed by the Information Sciences Institute at the University of Southern California, we focused analytics and work-flows appropriate to several challenge big data problems and demonstrated the utility of OODT-WINGS in addressing them. Specific demonstrated analyses address i crawling and indexing the XNET contents in a quick-reaction demonstration in January 2013, ii a data triage characterization of the Kiva loan system, iii contributory work done on 5 of 6 XDATA summer 2013 workshop challenge problems, and iv demonstration of end-to-end processing work-flow in conjunction with the USC Institute for Creative Technologies end-user interface at the September 2013 DARPA open house. Two papers published during this time addressed i the overall data triage use case, and II work flow characterization during time-bounded operations.