Joint Resource Allocation and Computation Offloading for DNN Inference with Model Partition and Early Exit in MEC Networks

The development of Artificial Intelligence (AI) and edge computing gives rise to the edge intelligence, where the intelligent tasks such as Deep Neural Network (DNN) based inference can be cooperatively done by edge server and devices. Existing methods often treat DNN based task as indivisible unit, optimizing computation offloading and resource allocation without exploiting the structural flexibility of DNN model. In this work, we investigate the joint optimization problem of resource allocation and computation offloading in the Multi-access Edge Computing (MEC) network for DNN inference tasks. The objective is to maximize the inference accuracy while minimizing the task latency, through the jointly design of DNN model partition, early exiting selection, device association, bandwidth and computation resource allocation. In addition, we consider the long-term optimization so the random generation of tasks and queue stability at devices and servers are also taken into account. As the formulated problem is hard to solve, we opt to the Deep Reinforcement Learning (DRL) approach and leverage the Transformer aided Deep Deterministic Policy Gradient (TDDPG) algorithm to find the solution. Simulations confirm the promising performance of the proposed algorithm, which outperforms the other benchmark schemes.