File(s) not publicly available

Priority based Modeling and Comparative study of Google Cloud Resources between 2011 and 2019

conference contribution
posted on 23.03.2021, 21:06 authored by Dimuth Lasantha, Biplob RayBiplob Ray
The cloud resource allocation for jobs must be further optimized and prioritised due to ever increasing demand for cloud computing resources to handle big data. In this research, we have examined the relationship between resource allocation, usages, and priority of tasks to reveal the influence of priority in resource allocation and resource usages. The analysis and modeling of this paper have used the Google cloud public dataset of 2011 and 2019. After processing and cleaning of one month data of Google cloud, we have revealed, the tasks are classified in 12 priorities in the 2011 cluster model whereas 500 priorities in the 2019 cluster model. However, both models have grouped these priorities into five groups. Therefore, we have modeled resource allocation versus usages based on five main priority groups using XGBoost (Extreme Gradient Boosting) and correlation coefficient. The comparative study on the developed models shows, the priority grouping of 2019 has better evenly distribution of resources for jobs but less efficient in most of the priority groups for resource allocation. Based on the performance parameters of the developed models, the resource allocation works more efficiently for most of the 2011 priority groups except 'other'. These findings are useful for researchers to develop a balanced priority-based resource allocation-usages model to further optimise resources to reduce the management cost of cloud clusters.

History

Editor

Wang G; Ko R; Bhuiyan MZA; Pan Y

Start Page

1310

End Page

1317

Number of Pages

8

Start Date

29/12/2020

Finish Date

01/01/2021

eISSN

2324-9013

ISSN

2324-898X

ISBN-13

9780738143804

Location

Guangzhou, China

Publisher

IEEE

Place of Publication

Piscataway, NJ

Peer Reviewed

Yes

Open Access

No

Author Research Institute

Centre for Intelligent Systems

Era Eligible

Yes

Name of Conference

2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications

Parent Title

Proceedings of the 2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications: TrustCom 2020