Embracing Statistical Challenges in the Information Technology Age
CALIFORNIA UNIV BERKELEY DEPT OF STATISTICS
Pagination or Media Count:
Information Technology is creating an exciting time for statistics. In this article, we review the diverse sources of IT data in three clusters IT core, IT systems, and IT fringe. The new data forms, huge data volumes, and high data speeds of IT are contrasted against the constraints on storage, transmission and computation to point to the challenges and opportunities. In particular, we describe the impacts of IT on a typical statistical investigation of data collection, data visualization, and model fitting, with an emphasis on computation and feature selection. Moreover, two research projects on network tomography and arctic cloud detection are used throughout the paper to bring the discussions to a concrete level.
- Statistics and Probability
- Computer Programming and Software
- Computer Systems