Lightweight Deep Reinforcement Learning Model for Energy-Efficient Resource Allocation in Edge Computing
Article Sidebar
Main Article Content
Abstract
A lightweight digital twin model for a single 6G cell operating in the D-band (140 GHz) with a 1 GHz bandwidth is presented in this work with the goal of assessing the cell's capacity, coverage, and terminal time in order to support extended reality (XR) applications. With a tangent dispersion of 3 dB and a path exponent of n = 2.2, the model is based on the free-space loss equation as per ITU-R Recommendation P.525. The instantaneous capacity is determined using the Shannon-Hartley theorem. Three XR sessions are created every minute using a Poisson method, and their durations are determined by an exponential distribution (mean of 120 seconds). In accordance with 3GPP and Ericsson guidelines for normal XR loads, the bit needs per user are randomly selected to fall between 40 and 120 Mb/s. The average coverage was around 92%, the average cell capacity was approximately 5.1 Gb/s, and the edge capacity (lowest quintile) was approximately 230 Mb/s, according to fifty statistical forecasts. Additionally, the 95th percentile round-trip latency was 3.9 ms, which is significantly less than the permitted maximum (10–20 ms) for immersive XR research. These findings suggest that modest XR loads may be supported by a 250-meter cell with a high-gain antenna layout without the need to immediately lower the radius or raise the transmitted power. However, the model remains theoretical and simplified, excluding geometric blockage and cell overlap in complex metropolitan environments.
Article Details
Issue
Section
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
References
[1] M. . Nawaz Khan and I. . Ahmad , Trans., “Harnessing Digital Twins: Advancing Virtual Replicas for Optimized System Performance and Sustainable Innovation”, Babylonian Journal of Mechanical Engineering, vol. 2025, pp. 18–33, Feb. 2025, https://doi.org/10.58496/BJME/2025/002.
[2] K. Framling, J. Holmstrom, T. Ala-Risku, M. Karkkainen, "Product agents for handling information about physical objects,” Report of Laboratory of Information Processing, Helsinki University of Technology, 2003.
[3] Zhang Y., “Introduction. In: Digital Twin,” Simula SpringerBriefs on Computing, vol 16, Springer, Cham. 2024, https://doi.org/10.1007/978-3-031-51819-5_1.
[4] Wenzheng, L. Construction Methods, “Data-Driven, and Operational Modes of Digital Twin Basin,” In Proceedings of the 2023 IEEE 13th International Conference on Electronics Information and Emergency Communication (ICEIEC), Beijing, China, pp. 158–161, July 2023.
[5] Wei, Z.; Wang, S.; Li, D.; Gui, F.; Hong, S. Data-Driven Routing: A Typical Application of Digital Twin Network. In Proceedings of the 2021 IEEE 1st International Conference on Digital Twins and Parallel Intelligence (DTPI), Beijing, China, 15 July 2021–15 August 2021; pp. 1–4.
[6] Li, S.; Lin, X.; Wu, J.; Zhang, W.; Li, J. Digital Twin and Artificial Intelligence-Empowered Panoramic Video Streaming: Reducing Transmission Latency in the Extended Reality-Assisted Vehicular Metaverse. IEEE Veh. Technol. Mag. 2023, 18, 56–65.
[7] Chen, D.; Yang, H.; Zhou, C.; Lu, L.; Lü, P.; Sun, T. Classification, Building and Orchestration Management of Digital Twin Network Models. In Proceedings of the 2022 IEEE 22nd International Conference on Communication Technology (ICCT), Nanjing, China, 11–14 November 2022; pp. 1843–1846. [Google Scholar] [CrossRef]
[8] Polverini, M.; Lavacca, F.G.; Galán-Jiménez, J.; Aureli, D.; Cianfrani, A.; Listanti, M. Digital Twin Manager: A Novel Framework to Handle Conflicting Network Applications. In Proceedings of the 2022 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN), Phoenix, AZ, USA, 14–16 November 2022; pp. 85–88. [Google Scholar] [CrossRef]
[9] Jian, M.; Long, B.; Liu, H. A Survey of Extended Reality in 3GPP Release 18 and Beyond. Highlights Sci. Eng. Technol. 2023, 56, 542–549. [Google Scholar] [CrossRef]
[10] Caudell, T.; Mizell, D. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences, Kauai, HI, USA, 7–10 January 1992; Volume 2, pp. 659–669. [Google Scholar] [CrossRef]
[11] Brooks, F. What’s real about virtual reality? IEEE Comput. Graph. Appl. 1999, 19, 16–27. [Google Scholar] [CrossRef]
[12] Guan, J.; Irizawa, J.; Morris, A. Extended Reality and Internet of Things for Hyper-Connected Metaverse Environments. In Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Christchurch, New Zealand, 12–16 March 2022; pp. 163–168. [Google Scholar] [CrossRef]
[13] Pereira, V.; Matos, T.; Rodrigues, R.; Nóbrega, R.; Jacob, J. Extended Reality Framework for Remote Collaborative Interactions in Virtual Environments. In Proceedings of the 2019 International Conference on Graphics and Interaction (ICGI), Faro, Portugal, 21–22 November 2019; pp. 17–24. [Google Scholar] [CrossRef]
[14] Dinh-Hieu Tran, “Network Digital Twin for 6G and Beyond: An End-to-End View Across Multi-Domain Network Ecosystems,” arXiv:2506.01609v1 [cs.NI] 02 Jun 2025. https://doi.org/10.48550/arXiv.2506.01609
[15] Calle-Heredia, Xavier, and Xavier Hesselbach. 2024. "Digital Twin-Driven Virtual Network Architecture for Enhanced Extended Reality Capabilities" Applied Sciences 14, no. 22: 10352. https://doi.org/10.3390/app142210352.
[16] Yang, Chao, Xinyi Tu, Juuso Autiosalo, Riku Ala-Laurinaho, Joel Mattila, Pauli Salminen, and Kari Tammi. 2022. "Extended Reality Application Framework for a Digital-Twin-Based Smart Crane" Applied Sciences 12, no. 12: 6030. https://doi.org/10.3390/app12126030.
[17] J. Zhang et al., "Reducing Mobile Web Latency Through Adaptively Selecting Transport Protocol," in IEEE/ACM Transactions on Networking, vol. 31, no. 5, pp. 2162-2177, Oct. 2023, doi: 10.1109/TNET.2023.3235907.
[18] Xu, Z.; Wu, S.; Zhang, L. A New Architecture of Augmented Reality Engine. In Proceedings of the 2023 2nd International Conference on Mechatronics and Electrical Engineering (MEEE), Abu Dhabi, United Arab Emirates, 10–12 February 2023; pp. 64–68.
[19] Zhang, Z.; Weng, D.; Jiang, H.; Liu, Y.; Wang, Y. Inverse Augmented Reality: A Virtual Agent’s Perspective. In Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Munich, Germany, 16–20 October 2018; pp. 154–157.
[20] Shin, J.H.; Park, S.J.; Kim, M.A.; Lee, M.J.; Lim, S.C.; Cho, K.W. Development of a Digital Twin Pipeline for Interactive Scientific Simulation and Mixed Reality Visualization. IEEE Access 2023, 11, 100907–100918.
[21] Kamdjou, H.M.; Baudry, D.; Havard, V.; Ouchani, S. Resource-Constrained EXtended Reality Operated With Digital Twin in Industrial Internet of Things. IEEE Open J. Commun. Soc. 2024, 5, 928–950.
[22] Zhong, Y.; Marteau, B.; Hornback, A.; Zhu, Y.; Shi, W.; Giuste, F.; Krzak, J.J.; Graf, A.; Chafetz, R.; Wang, M.D. IDTVR: A Novel Cloud Framework for an Interactive Digital Twin in Virtual Reality. In Proceedings of the 2022 IEEE 2nd International Conference on Intelligent Reality (ICIR), Piscataway, NJ, USA, 14–16 December 2022; pp. 21–26.
[23] Al-Saman, Ahmed, Marshed Mohamed, Michael Cheffena, and Arild Moldsvor. 2021. "Wideband Channel Characterization for 6G Networks in Industrial Environments" Sensors 21, no. 6: 2015. https://doi.org/10.3390/s21062015
[24] Künz, A.; Rosmann, S.; Loria, E.; Pirker, J. The Potential of Augmented Reality for Digital Twins: A Literature Review. In Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Christchurch, New Zealand, 12–16 March 2022; pp. 389–398.
[25] Böhm, F.; Dietz, M.; Preindl, T.; Pernul, G. Augmented Reality and the Digital Twin: State-of-the-Art and Perspectives for Cybersecurity. J. Cybersecur. Priv. 2021, 1, 519–538.
[26] Trindade, Nuno Verdelho, Alfredo Ferreira, João Madeiras Pereira, and Sérgio Oliveira. "Extended reality in AEC." Automation in Construction 154 (2023): 105018.
[27] Chen, H.; Xu, X.; Simsarian, J.; Szczerban, M.; Harby, R.; Ryf, R.; Mazur, M.; Dallachiesa, L.; Fontaine, N.; Cloonan, J.; et al. Digital Twin of a Network and Operating Environment Using Augmented Reality. In Proceedings of the 49th European Conference on Optical Communications (ECOC 2023), Glasgow, UK, 1–5 October 2023.
[28] Hübel, N.; Kaigom, E.G. Codeless, Inclusive, and End-to-End Robotized Manipulations by Leveraging Extended Reality and Digital Twin Technologies. In Proceedings of the 2024 16th International Conference on Human System Interaction (HSI), Paris, France, 8–11 July 2024; pp. 1–6.
[29] R. Badeel, M. Abdal, R. A. Ahmed, and H. H. Mohamed , Trans., “From 1G to 6G: Review of history of Wireless Technology Development, Architecture, Applications, and Challenges”, Applied Data Science and Analysis, vol. 2024, pp. 189–198, Dec. 2024, doi: 10.58496/ADSA/2024/015.
[30] P. K, V. Sharma, N. Yuvaraj, R. P. Shukla, D. Kumar and M. Manwal, "Fair Resource Allocation in 6G networks using Reinforcement Learning," 2024 International Conference on Recent Innovation in Smart and Sustainable Technology (ICRISST), Bengaluru, India, 2024, pp. 1-6, doi: 10.1109/ICRISST59181.2024.10921887.
[31] J. Koo, V. B. Mendiratta, M. R. Rahman and A. Walid, "Deep Reinforcement Learning for Network Slicing with Heterogeneous Resource Requirements and Time Varying Traffic Dynamics," 2019 15th International Conference on Network and Service Management (CNSM), Halifax, NS, Canada, 2019, pp. 1-5, doi: 10.23919/CNSM46954.2019.9012702.