The Terabyte Challenge, which is the testbed for Project DataSpace, will link 12 sites across 5 continents and demonstrate a variety of DataSpace applications which will publish, access, analyze, correlate and manipulate remote and distributed data. For example, in the Sky Survey application, the DSTP Client downloads stellar object catalog data from a dstp Server, creates a machine learning model based on pmml, and scores large amounts of data at high rates using high performance dstp applications we have developed. We expect even higher rates at this year's Supercomputing Conference using a new release of our sofware. The Network Storm application will demonstrate the flexibility of the dstp protocol. Application servers will be set up on 3 continents to collect network traffic data.
Any dstp client can download data and view the state of the network.
Ultimately the group plans to build an infrastructure that will predict network storms and allow for improved network traffic management. We will also demonstrate several other high performance DSTP applications.