End to end requirements matching. The end to end requirements for gigabit applications are demanding. Data must be extracted off of disk and tape, processed, moved across the network, processed at the other end, visualized, and stored onto disk and tape. Extracting and storing data places additional requirements that are not present with computational and streaming data applications. Balancing gigabit networks with gigabit data archives.
Big data requires big cpus.
As the amount of data grows and as the number of people interested in accessing it grows, new problems emerge, including data distribution policies, data caching policies, data multi-casting etc. Better network instrumentation. Current network instrumentation does not directly support the needs of data intensive gigbit application developers. For data intensive gigabit applications to be developed better tools for measuring data movement and network utilization are needed. The familar problems.