High-Bandwidth Tactical-Network Data Analysis in a High-Performance-Computing (HPC) Environment: Data Marshalling
Final rept. Jul 2012-Dec 2014
ARMY RESEARCH LAB ABERDEEN PROVING GROUND MD COMPUTATIONAL AND INFORMATION SCIENCES DIRECTORATE
Pagination or Media Count:
Teams from the Aberdeen Test Center and the US Army Research Laboratory collaborated to design and build a system-of-processes with a goal of reliably marshalling data from a large-scale remote tactical network field test, shuttling the data cross-country, and performing reduction and analysis. The progression of going from terabytes of raw collected field data to a data product that can be used by analysts and evaluators required coordination of people and hardware from several cross-country sites. This system-of-processes reliably worked over a 2-month time span, processing an average of 1.5 TB of raw field-collected data a day. This report describes methods, processes, and systems employed to go from raw data to a finished data product in a short time period several days to facilitate Army decision making on a major communications system production.
- Computer Systems Management and Standards