File(s) not publicly available

The optimization potential of volunteer computing for compute or data intensive applications

journal contribution
posted on 06.11.2019, 00:00 authored by Wei LiWei Li, Wanwu GuoWanwu Guo
The poor scalability of Volunteer Computing (VC) hinders the application of it because a tremendous number of volunteers are needed in order to achieve the same performance as that of a traditional HPC. This paper explores optimization potential to improve the scalability of VC from three points of view. First, the heterogeneity of volunteers’ compute-capacity has been chosen from the whole spectrum of impact factors to study optimization potential. Second, a DTH (Distributed Hash Table) based supporting platform and MapReduce are fused together as the discussion context. Third, transformed versions of work stealing have been proposed to optimize VC for both compute-and data-intensive applications. On this basis, the proposed optimization strategies are evaluated by three steps. First, a proof-of-concept prototype is implemented to support the representation and testing of the proposed optimization strategies. Second, virtual tasks are composed to apply certain compute-or data-intensity on the running MapReduce. Third, the competence of VC, running the original equity strategy and the optimization strategies, is tested against the virtual tasks. The evaluation of results has confirmed that the impaired performance has been improved about 24.5% for computeintensive applications and about 19.5% for data-intensive applications.

History

Volume

14

Issue

10

Start Page

971

End Page

979

Number of Pages

9

ISSN

1796-2021

Publisher

Engineering and Technology Publishing

Peer Reviewed

Yes

Open Access

No

Acceptance Date

05/09/2019

Era Eligible

Yes

Journal

Journal of Communications