CQUniversity
Browse

Deep reinforcement learning based multi-WiFi offloading of UAV traffic

conference contribution
posted on 2024-12-10, 01:48 authored by Z Liu, Hong ShenHong Shen
As the growing network deployment of Unmanned Aerial Vicheles (UAVs), traffic offloading has been widely used to mitigate UAV's problem of limited bandwidth in communications due to limited battery capacity. Existing work on traffic offloading has focused on reducing the average delay of the system without considering the fairness issue, and assumed that data transmission follows line-of-sight propagation which contradicts with the realistic situations in both urban and suburban areas. Achieving both fairness and system efficiency with non-line-of-sight user-UAV communication requires to solve a complex non-convex optimization problem. This paper proposes an effective algorithm (NAPPO) for joint UAV navigation and user traffic allocation by applying deep reinforcement learning (DRL). Our NAPPO applies DRL to collect user information (position, data rate and traffic demand) and dynamically adjusts the UAV position and traffic allocation ratio to minimize the maximum delay and hence improve the fairness (i.e., variation in delay between users). We show that our proposed approach of minimizing maximum delay is more effective than minimizing average delay for achieving fairness while preserving the total delay at a reasonable level. The results of the simulation experiments show that NAPPO achieves an impressive performance on the maximum delay, i.e., 49. 82% better than the heuristic algorithm and only 0.1536s worse than the optimal solution.

Funding

Category 2 - Other Public Sector Grants Category

History

Editor

Park JS; Takizawa H; Shen H; Park JJ

Volume

1112 LNEE

Start Page

227

End Page

238

Number of Pages

12

Start Date

2023-08-16

Finish Date

2023-08-18

eISSN

1876-1119

ISSN

1876-1100

ISBN-13

9789819982103

Location

Jeju, Korea

Publisher

Springer

Place of Publication

Singapore

Peer Reviewed

  • Yes

Open Access

  • No

Era Eligible

  • Yes

Name of Conference

The 24th International Conference on Parallel and Distributed Computing, Applications and Technologies

Parent Title

Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings

Usage metrics

    CQUniversity

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC