Tag Archive for: paper

“Federated Deep Reinforcement Learning for Prediction-Based Network Slice Mobility in 6G Mobile Networks” Journal Paper

/in /by

Network slices are generally coupled with services and face service continuity/unavailability concerns due to the high mobility and dynamic requests from users. Network slice mobility (NSM), which considers user mobility, service migration, and resource allocation from a holistic view, is witnessed as a key technology in enabling network slices to respond quickly to service degradation. Existing studies on NSM either ignored the trigger detection before NSM decision-making or didn’t consider the prediction of future system information to improve the NSM performance, and the training of deep reinforcement learning (DRL) agents also faces challenges with incomplete observations. To cope with these challenges, we consider that network slices migrate periodically and utilize the prediction of system information to assist NSM decision-making. The periodical NSM problem is further transformed into a Markov decision process, and we creatively propose a prediction-based federated DRL framework to solve it. Particularly, the learning processes of the prediction model and DRL agents are performed in a federated learning paradigm. Based on extensive experiments, simulation results demonstrate that the proposed scheme outperforms the considered baseline schemes in improving long-term profit, reducing communication overhead, and saving transmission time.

“A novel approach to self-capabilities in IoT industrial automation computing continuum” paper presentation

/in , , /by

aerOS paper entitled “A novel approach to self-capabilities in IoT industrial automation computing continuum” was presented during WF-IoT 2023! The 2023 IEEE 9th World Forum on Internet of Things (WF-IoT 2023) brings the latest from the research and academic community. It included a broad program of papers and presentations on the latest technology developments and innovations in the many fields and disciplines that drive the utility and vitality of IoT solutions and applications. After extensive peer review, the best of the proposals were selected for the conference program, which included technical papers, tutorials workshops and industry sessions designed specifically to advance technologies, end to end solutions, systems and infrastructure, processes, and operating methods, that are contributing to how IoT can reshape the world and overcome the challenges we face, so that all individuals can participate in and enjoy life to the fullest.

“A Survey on In-Network Computing: Programmable Data Plane and Technology Specific Applications” Paper

/in , /by

The aerOS journal paper entitled “A Survey on In-Network Computing: Programmable Data Plane and Technology Specific Applications” is now available!
In comparison with cloud computing, edge computing offers processing at locations closer to end devices and reduces the user experienced latency. The new recent paradigm of in-network computing employs programmable network elements to compute on the path and prior to traffic reaching the edge or cloud servers. It advances common edge/cloud server based computing through proposing line rate processing capabilities at closer locations to the end devices. This paper discusses use cases, enabler technologies and protocols for in-network computing. According to our study, considering programmable data plane as an enabler technology, potential in-network computing applications are in-network analytics, in-network caching, in-network security, and in-network coordination. There are also technology specific applications of in-network computing in the scopes of cloud computing, edge computing, 5G/6G, and NFV. In this survey, the state of the art, in the framework of the proposed categorization, is reviewed. Furthermore, comparisons are provided in terms of a set of proposed criteria which assess the methods from the aspects of methodology, main results, as well as application-specific criteria. Finally, we discuss lessons learned and highlight some potential research directions.
Find more information about the paper here: https://ieeexplore.ieee.org/document/9919270

A Novel Combinatorial Multi-Armed Bandit Game to Identify Online the Changing top-K Flows in Software-Defined Networks – Paper

/in , /by

Identifying the top-K flows that require much more bandwidth resources in a large-scale Software-Defined Network (SDN) is essential for many network management tasks, such as load balancing, anomaly detection, and traffic engineering. However, identifying such top-K flows is not trivial, not only because of the fluctuations in flow bandwidth requirements but also because of the combinatorial explosion of problem instance sizes. In this paper, we weaken the tradeoff between exploration and exploitation and innovatively define the online top-K flows identification problem as identifying the top-K arms in a Combinatorial Multi-Armed Bandit (CMAB) model. Then, we propose a general greedy selection mechanism with some identification strategies that focus on temporal variations in the rewards. Extensive simulation experiments based on real traffic data are conducted to evaluate the performance of different strategies. In addition, the results of numerical simulations demonstrate that our proposed greedy selection mechanism significantly outperforms existing counterparts on top-K arms identification.

Find the paper online here: http://mosaic-lab.org/uploads/papers/6fa449ad-7848-4db5-889f-f81f790b516d.pdf

“Cloud-Native Workload Orchestration at the Edge: A Deployment Review and Future Directions” Journal Paper

/in /by

The aerOS journal paper entitled “Cloud-Native Workload Orchestration at the Edge: A Deployment Review and Future Directions” was accepted in the MDPI, Sensors Journal, Volume 23, Issue 4.

Cloud-native computing principles such as virtualization and orchestration are key to transferring to the promising paradigm of edge computing. Challenges of containerization, operative models and scarce availability of established tools make a thorough review indispensable. Therefore, the authors have described the practical methods and tools found in the literature as well as in current community-led development projects, and have thoroughly exposed the future directions of the field. Container virtualization and its orchestration through Kubernetes have dominated the cloud computing domain, while major efforts have been recently recorded focused on the adaptation of these technologies to the edge. Such initiatives have addressed either the reduction of container engines and the development of specific tailored operating systems or the development of smaller K8s distributions and edge-focused adaptations (such as KubeEdge). Finally, new workload virtualization approaches, such as WebAssembly modules together with the joint orchestration of these heterogeneous workloads, seem to be the topics to pay attention to in the short to medium term.
You may find the publication online here: https://www.mdpi.com/1424-8220/23/4/2215