The reason this problem is so difficult lies in its mathematical structure. Task scheduling in edge and fog environments is formally classified as NP-hard, meaning that the time required to find the perfect solution grows explosively with the size of the problem. A fog network might contain dozens of heterogeneous nodes, each with different processing speeds, memory capacities, energy budgets and network conditions, while the tasks arriving at those nodes vary wildly in size, deadline sensitivity and dependencies on other tasks. Classical heuristics and metaheuristics, such as ant colony optimization or grey wolf optimization, have long been used to find good-enough solutions quickly. But these approaches typically rely on static assumptions about the environment, and edge and fog networks are anything but static. Devices join and leave, wireless links fluctuate, and workloads surge unpredictably, which is precisely where learning-based methods promise an advantage.

Reinforcement learning reframes scheduling as a sequential decision game. An agent observes the state of the system, such as queue lengths, resource availability and task characteristics, selects an action like assigning a task to a particular node, and receives a numerical reward reflecting outcomes such as reduced latency or lower energy consumption. Over many iterations, the agent learns a policy that maximizes cumulative reward. Deep reinforcement learning extends this idea by using deep neural networks to approximate the value of states or actions, allowing the agent to cope with enormous, continuous state spaces that would overwhelm tabular methods. The survey traces how this family of techniques, from foundational Q-learning through deep Q-networks, double deep Q-networks, actor-critic methods such as A2C and SAC, and policy gradient approaches like deep deterministic policy gradient, has been adapted to the specific demands of edge and fog infrastructures.

What sets the new survey apart is the breadth of its comparison framework. Rather than simply listing algorithms, the authors evaluate them across a systematic set of dimensions: the case study context, the type of tasks being scheduled, how the optimization problem is formally formulated, the specific reinforcement learning technique employed, the simulation or evaluation tools used, the performance metrics reported, and the learning and execution architecture, whether centralized, distributed, or federated. They also catalog advanced features such as security awareness, fault tolerance, energy optimization and privacy preservation, alongside the limitations each algorithm admits. This multidimensional lens reveals patterns that a simple performance comparison would miss, for instance that the choice between value-based and actor-critic methods often hinges on whether the action space is discrete, as in choosing one of several servers, or continuous, as in tuning transmission power levels.

Among the most consequential trends the survey documents is the shift toward multi-agent and federated learning architectures. In a centralized scheme, a single agent observes everything and decides everything, which becomes a bottleneck and a single point of failure at scale. Multi-agent deep reinforcement learning distributes the intelligence, letting individual nodes or device groups learn cooperatively or independently. Federated reinforcement learning goes further, allowing agents to share learned knowledge without exchanging raw data, a property that matters enormously in privacy-sensitive settings such as healthcare and smart cities. The reviewed literature includes federated deep Q-networks paired with clustering techniques, federated deep recurrent Q-learning for satellite-assisted industrial IoT, and multi-agent approaches for vehicular fog networks, where cars themselves act as fleeting computing nodes whose positions change by the second.

Vehicular computing emerges as one of the most demanding and active application domains in the surveyed corpus. Vehicles move at high speed, producing tasks with hard latency deadlines for safety-critical functions like collision avoidance, while connectivity to fog nodes is intermittent. Studies cited in the survey apply asynchronous deep reinforcement learning to secure offloading in vehicular edge networks, priority-aware offloading based on deep Q-learning, and distributed twin delayed deep deterministic policy gradient, known as TD3, for multi-objective optimization across mobile edge and vehicular-fog systems. Other domains represented include industrial IoT, where decentralized multi-agent systems coordinate partial task offloading across factories, augmented reality offloading in mobile edge networks, smart agriculture, power grid IoT, and unmanned aerial vehicles that serve as airborne edge servers with their own energy constraints.

The survey also shines a light on the unglamorous but critical question of how these algorithms are actually tested. The authors catalog the dominant evaluation platforms, including iFogSim, EdgeCloudSim, CloudSim, EdgeSimPy, SimPy, OMNeT++, the FogBus framework, the COSCO container orchestration system and the AirFogSim simulator for UAV-integrated vehicular fog. On the machine learning side, implementations typically rely on PyTorch, TensorFlow and Keras, with OpenAI Gym and Stable-Baselines3 providing standardized training environments and reliable algorithm implementations. This tooling inventory matters because reproducibility remains a weak point in the field: results obtained in one simulator often fail to transfer cleanly to another, and the survey’s accounting of which studies used which tools gives researchers a common baseline for fair comparison. Performance metrics cluster around makespan, response time, energy consumption, load balance, cost, throughput and quality-of-service violation rates, with recent work increasingly optimizing several of these simultaneously through weighted or Pareto-based multi-objective formulations.

Despite the evident progress, the survey is candid about the field’s open problems. Many proposed algorithms are trained and evaluated under simplified assumptions that ignore security threats, node failures and the full heterogeneity of real hardware. The gap between simulation and deployment remains wide, and the computational cost of training deep agents can itself conflict with the resource constraints of edge devices. Scalability of centralized training looms large, and the survey highlights emerging directions meant to close these gaps: transformer-enhanced distributed deep reinforcement learning, meta-reinforcement learning that lets agents adapt rapidly to unseen environments, hybrid schemes combining fuzzy logic or graph attention networks with learned policies, and privacy-preserving hierarchical frameworks for low-altitude vehicular fog. The authors also point toward better handling of dependent tasks, where directed acyclic graphs of interlinked computations must be placed jointly rather than one at a time.

For the broader technology landscape, the stakes of this research line are hard to overstate. The number of IoT devices continues to climb, and the latency-sensitive applications they enable, from autonomous driving to remote surgery to real-time industrial control, simply cannot tolerate the round trip to a distant cloud. Edge and fog computing supply the physical infrastructure, but intelligence about where and when to run each computation is what turns that infrastructure into a functioning system. By consolidating and comparing the deep reinforcement learning literature across environments, task types, algorithms, tools and metrics, the survey provides both a status report and a research agenda. It suggests that the next generation of schedulers will be distributed, privacy-aware, energy-conscious and capable of learning on the fly, qualities that will determine whether the promised era of ubiquitous, responsive computing actually arrives on schedule.

Subject of Research: Deep reinforcement learning-based task scheduling and offloading in edge and fog computing

Article Title: A comparative analysis of deep reinforcement learning based task scheduling and offloading in edge and fog computing: a comprehensive survey

Article References: Bouafia, Z., Mededjel, M., Ghalem, B., & Mokadem, R. (2026). A comparative analysis of deep reinforcement learning based task scheduling and offloading in edge and fog computing: a comprehensive survey. Cluster Computing, 29(14), Article 795. https://doi.org/10.1007/s10586-026-06601-z

Image Credits: AI Generated

DOI: 10.1007/s10586-026-06601-z

Keywords: edge computing, fog computing, deep reinforcement learning, task scheduling, task offloading, Internet of Things, multi-agent reinforcement learning, federated learning, vehicular edge computing, NP-hard optimization, resource allocation, Cluster Computing

The core problem the researchers tackle is a trio of persistent headaches in vehicular edge computing. First, traffic conditions are notoriously difficult to characterize precisely, which means offloading decisions are often made with imperfect information. Second, electric vehicles face acute energy constraints, and wasteful task allocation can drain batteries that drivers need for the road. Third, the conventional approach of pooling vehicle data into a centralized server to train decision-making models raises serious privacy concerns, since driving trajectories and task profiles can reveal sensitive personal information. EFF-FedRL addresses all three simultaneously by weaving together two complementary branches of artificial intelligence: adaptive fuzzy logic for interpreting messy, real-world conditions, and federated deep reinforcement learning for making smart offloading choices without exposing raw data.

The fuzzy logic component acts as the framework’s local perception layer. Inside each participating system, a lightweight fuzzy inference system evaluates current traffic conditions, variables such as congestion density, vehicle speed distributions, and communication quality, using linguistic rules rather than brittle binary thresholds. Because fuzzy systems can gracefully handle vague and noisy inputs, they are well suited to the chaotic reality of urban traffic. The output of this inference step is not a decision itself; instead, it dynamically tunes the reward function of the reinforcement learning agent downstream. In other words, the fuzzy system tells the learning agent how to weigh competing objectives like speed versus energy under the prevailing conditions. In dense rush-hour traffic the reward weighting shifts one way; on a quiet late-night corridor it shifts another. This adaptivity is what the authors call the framework’s energy-aware conscience.

At the heart of the decision engine sits a Duelling Double Deep Q-Network, commonly abbreviated D3QN, running independently at each Road Side Unit. Deep Q-networks learn a value function that estimates the long-term benefit of each possible action, here meaning which offloading target should receive a given task. The duelling architecture separates the estimation of the overall value of a state from the relative advantage of each action, which improves learning stability, while the double Q-learning trick decouples action selection from action evaluation to dampen the overestimation bias that plagues standard Q-learning. Crucially, the D3QN agents in EFF-FedRL are equipped with an energy-aware reward mechanism tailored to the traffic scenario identified by the fuzzy layer, so each RSU’s agent learns offloading policies that reflect the specific energy and latency trade-offs of its own environment rather than a one-size-fits-all average.

Privacy protection enters through federated learning. Rather than shipping raw task and traffic data to a central server, each RSU trains its agent locally, and only the resulting model gradients are shared. Those gradients are first protected with differential privacy, a mathematical technique that injects carefully calibrated noise so that the contribution of any single vehicle’s data cannot be reverse-engineered, and then aggregated using the FedAvg algorithm, which averages the locally updated models into a shared global model. The combined effect is that roadside units can collectively benefit from one another’s learning experience, achieving the generalization power of a centralized model, without any participant ever surrendering raw data. The authors emphasize that this design maintains meaningful privacy guarantees while imposing minimal computational overhead relative to traditional centralized training methodologies.

Validation was carried out with a simulation stack that researchers in the connected-vehicle community regard as a de facto standard. Traffic mobility was generated with SUMO, the Simulation of Urban MObility package, version 1.18.0, integrated with the Veins framework, version 5.2, running on OMNeT++ version 6.0. Importantly, the mobility traces were not synthetic abstractions: they are based on a realistic six-by-six kilometer area of Bologna’s city center, drawn from the publicly available iTETRIS project and the Monaco SUMO Traffic scenario. Anchoring the experiments to real urban traffic data lends considerable weight to the reported improvements, because vehicular networks are famously sensitive to the idiosyncrasies of actual road geometry, signal timing, and driver behavior. The authors state that processed datasets and simulation scripts are available from the corresponding author upon reasonable request, and the full framework code, including the fuzzy inference engine, the PyTorch-based D3QN implementation, and the privacy-preserving federated averaging module, will be released publicly on GitHub.

The headline results speak to the framework’s practical promise. Across the simulations, EFF-FedRL cut energy consumption by 41.3 percent compared with baseline approaches, a figure with direct consequences for electric vehicle range, since every joule saved on computation is a joule available for propulsion. Latency fell by 33.8 percent, which matters enormously for delay-sensitive applications such as collision avoidance and real-time video analytics, where even tens of milliseconds can separate a safe maneuver from a dangerous one. Meanwhile, the task completion rate of 99.4 percent indicates that the energy savings did not come at the cost of leaving work undone, a trade-off that has undermined many earlier optimization schemes. The framework also preserved its privacy protections and kept computational overhead low, suggesting it could be deployed on real roadside hardware without prohibitive cost.

The significance of this work extends beyond a single set of benchmarks. Task offloading in vehicular edge computing has historically been treated as either a scheduling problem solved with heuristics or a learning problem solved with centralized deep reinforcement learning, each approach carrying well-known liabilities. Heuristics adapt poorly to shifting traffic regimes, while centralized learning creates both a privacy bottleneck and a communication burden. By combining a fuzzy perception layer with federated reinforcement learning, EFF-FedRL sketches a blueprint for edge intelligence that is simultaneously adaptive, energy-conscious, and privacy-preserving. The work sits within a rapidly growing literature; the authors’ references span surveys of vehicular edge computing and networking, differentially private federated learning for the Internet of Vehicles, fuzzy-logic-assisted Q-learning for 6G V2X resource allocation, and energy-aware federated methods for edge computing, positioning the study at the confluence of several active research streams.

Challenges remain before such systems reach production. The results derive from simulation, however realistic the underlying traces, and real deployments will add radio interference, hardware heterogeneity, and adversarial conditions that no simulator fully captures. Differential privacy inevitably involves a trade-off between privacy budgets and model accuracy, and the optimal calibration for live traffic systems remains an open question. Nevertheless, the direction is clear. As autonomous driving and connected vehicle services proliferate, the demand for distributed, energy-efficient, privacy-respecting computation at the network edge will only intensify. EFF-FedRL demonstrates that machines can learn to make energy-wise offloading decisions collectively, locally, and discreetly, and it offers a compelling preview of how the smart cities of the coming decade may manage the computational life of their streets. The research was supported by the Education Department of Hunan Province and the Guiding Science and Technology Plan Project of Changsha City.

Subject of Research: Energy-conscious task offloading in vehicular edge computing using adaptive fuzzy logic and federated deep reinforcement learning

Article Title: Energy-conscious task offloading for vehicular edge computing via adaptive fuzzy logic and federated learning

Article References: Liu, X., Liu, F., Shao, S., & Li, E. (2026). Energy-conscious task offloading for vehicular edge computing via adaptive fuzzy logic and federated learning. Cluster Computing, 29(13), Article 778. https://doi.org/10.1007/s10586-026-06618-4

Image Credits: AI Generated

DOI: 10.1007/s10586-026-06618-4

Keywords: vehicular edge computing, task offloading, energy efficiency, fuzzy logic, federated learning, deep reinforcement learning, D3QN, differential privacy, FedAvg, roadside units, SUMO simulation, intelligent transportation