Abstract-Single data center is difficult to meet current demands of data storage and computing resources, leading to data broadly stored in different data centers far from each other geographically. Cross-domain big data processing usually requires data from other data centers across different network. Since the network environment is extremely complex and large amount of data is required for computing, time spent in data transmission is unacceptable, resulting in slow scheduling. In this paper, we propose a cross-domain workflow scheduling system called Arana. By moving program close to data and integrating popular big data processing platform, this system enables user to complete computing with cross-domain data without transferring.
With respect to the multi-domain methods for the large-scale task processing, Gu et al. REF have proposed a cross-domain workflow scheduling system called Arana.
Arana: A Cross-domain Workflow Scheduling System
Proceedings of the 3rd International Conference on Wireless Communication and Sensor Networks (WCSN 2016)
Proceedings of the 3rd International Conference on Wireless Communication and Sensor Networks (WCSN 2016)
Computer Science