The rise of GPUs as the workhorse of scientific and commercial computing is one of the defining technological shifts of the past two decades. Originally designed to render graphics, GPUs have proven extraordinarily effective at single-instruction multiple-data workloads, a class of computation in which the same operation is applied simultaneously to enormous arrays of numbers. Machine learning training, image processing, physical simulation and large-scale data analytics all fall squarely into this category. But as the authors of the new study note, the era of easy gains in central processing unit performance has effectively ended. For decades, processor manufacturers delivered automatic speedups through higher clock frequencies and shrinking transistor sizes. Those trends have stalled, and the answer to ever-growing computational demand has shifted to parallelism, with GPU clusters now routinely deployed in place of CPU-only infrastructure for computationally intensive work.

That shift, however, has created a problem that the computing industry has only partially solved. Traditional distributed computing frameworks, including systems like Apache Storm and the widely used MapReduce model, were architected around CPUs and the assumption that each computing node would handle one task at a time. GPUs complicate this picture in two fundamental ways. First, a single GPU can execute many tasks concurrently, thanks to its thousands of lightweight cores and its ability to share memory and streaming multiprocessors among multiple processes. Second, tasks differ enormously in their resource requirements, their dependencies on other tasks and their sensitivity to delays. When a scheduler designed for one-task-per-node logic is applied to a cluster of GPUs, the result is exactly what the researchers observed: idle hardware, redundant data movement and allocations that leave powerful accelerators running at a fraction of their potential.

The GDSF framework, whose name reflects its grounding in GPU-accelerated distributed systems, was built from the ground up around the computational character of GPUs and the emerging technology of multi-task GPU sharing. Rather than treating a GPU as an indivisible resource that must be dedicated to a single job, the framework exploits fine-grained sharing primitives that allow several tasks to coexist on the same device, each drawing on a controlled slice of the GPU’s memory bandwidth and execution units. This approach draws on a line of research that includes systems such as Salus, which pioneered fine-grained GPU sharing primitives for deep learning applications, but the Chinese team extends the idea into a full distributed framework that spans an entire heterogeneous cluster of CPUs and GPUs.

A central technical contribution of the study lies in its treatment of task models. Real-world big data applications rarely consist of a flat list of independent jobs. Instead, they arrive as directed acyclic graphs, commonly called DAGs, in which some tasks must wait for the outputs of others before they can begin. Scheduling a DAG efficiently is a famously hard problem, and decades of research, including the influential work of Topcuoglu and colleagues on performance-effective and low-complexity scheduling for heterogeneous systems, have produced heuristics that trade optimality for speed. GDSF incorporates multiple scheduling strategies designed to cover both ends of this spectrum: one set of algorithms handles independent task models, where jobs can be dispatched to any available GPU in any order, and another set handles dependent task models expressed as DAGs, where precedence constraints must be respected while still maximizing GPU utilization. The goal, according to the authors, is to achieve an optimal match between the profile of each task and the resources each GPU can offer at a given moment.

The framework’s architecture reflects the lessons the team learned in earlier projects. The same group previously developed a fully distributed heterogeneous resource management system and a hybrid resource management system for clusters that mix CPU and GPU nodes, and they have published work on maximizing parallel K-means clustering on GPU clusters and on stream processing built around function-as-a-service infrastructure. That accumulated experience shows in the design decisions described in the new paper. GDSF maintains a global view of cluster resources while pushing execution decisions close to the hardware, a hybrid design that avoids both the bottlenecks of purely centralized schedulers and the inefficiencies of purely decentralized ones. The framework also draws on optimization techniques the authors have explored elsewhere, including multi-dimensional resource placement algorithms based on parallel genetic algorithms, to decide where data and computation should reside within the cluster.

To validate their design, the researchers turned to a real heterogeneous CPU-GPU cluster rather than a simulation, an important distinction in a field where synthetic benchmarks can mask the messy realities of contention, data transfer overheads and hardware variability. They subjected GDSF to a diverse suite of GPU workloads, measuring how well the framework and its scheduling algorithms matched tasks to devices, how much idle time the GPUs experienced, and how the overall throughput compared with conventional approaches. The results, the team reports, met the expected research objectives, demonstrating that the framework achieves both feasibility and effectiveness in practice. The published study includes extensive experimental material, with more than a dozen figures and five detailed algorithm descriptions documenting the scheduling logic and its performance across the test workloads.

The implications of the work extend well beyond the laboratory. GPU clusters are among the most expensive pieces of infrastructure on the planet, with individual accelerator cards costing tens of thousands of dollars and entire data centers consuming megawatts of electricity. Any improvement in GPU utilization translates directly into lower costs, reduced energy consumption and a smaller carbon footprint for the computing industry, a concern that has motivated parallel research into carbon-efficient scheduling of deep learning workloads. At the same time, the demands being placed on GPU infrastructure keep intensifying. Large language models, real-time video analytics, scientific simulation in fields from astrophysics to elastodynamics, and privacy-preserving computation such as homomorphic encryption all compete for the same pool of accelerators. A scheduler that can intelligently interleave dependent and independent tasks across shared GPUs could materially increase the amount of useful computation extracted from each device.

The study also situates itself within a broader research conversation. Its reference list spans graph processing frameworks such as SGgraph, GPU-accelerated MapReduce systems for knowledge extraction from uncertain data, deep learning inference frameworks for edge clusters, and specialized systems for volumetric video rendering and evolutionary multitasking optimization. This breadth reflects a recognition that the scheduling problem is common to nearly every domain where GPUs are deployed in clusters, and that insights from one field, such as fine-grained sharing from machine learning systems or DAG heuristics from classical heterogeneous computing, can be combined into a more general framework. By testing against diverse workloads rather than a single application type, the authors argue that GDSF offers a genuinely adaptable foundation for the heterogeneous big data platforms of the coming years.

The research was supported by the Key Research and Development Program of Shaanxi Province, the Industrialization Project of the Shaanxi Provincial Department of Education, the Science and Technology Program of Yulin City, and the Key Research and Development Plan of Xianyang City, underscoring the significant regional investment in advancing China’s high-performance computing capabilities. The team states that the data supporting the findings are available from the corresponding author upon reasonable request, and the authors declare no competing interests. For researchers and operators wrestling with the economics and performance of GPU clusters, GDSF offers a concrete demonstration that rethinking scheduling at the architectural level, rather than layering minor tweaks onto CPU-era frameworks, can deliver the efficiency gains that the next generation of big data applications will demand.

The newly operational Quantum Development Kit (QB-QDK2.0) distinguishes itself by operating without the need for cryogenic cooling systems, which have long been a challenging bottleneck in quantum technology deployment. Instead, this compact device fits neatly within a standard 19-inch server rack, marrying energy efficiency with seamless integration capabilities. This novel hybrid quantum-classical platform promises to revolutionize computational workflows by embedding quantum processing units (QPUs) right alongside classical co-processors including NVIDIA GPUs and conventional CPUs.

Fraunhofer IAF’s Director, Prof. Rüdiger Quay, highlighted the significance of this integration, humorously noting how the leftover rack space in standard IT infrastructure finally found a meaningful purpose with the QB-QDK2.0. The fusion of Quantum Brilliance’s hardware with the open-source Qristal software development kit and emulator places Fraunhofer IAF at the forefront of quantum computing research, empowering scientists to traverse the entire gamut from quantum algorithm formulation to advanced hardware testing under a unified platform.

One of the QB-QDK2.0’s defining characteristics is its compact and robust engineering. The device consolidates quantum and classical processing units within a single module, reducing latency and fostering efficient implementation of hybrid algorithms. This close physical proximity facilitates sophisticated computational paradigms such as quantum machine learning, where quantum neural networks can be effectively coupled with classical architectures, pushing the envelope of algorithmic performance and scaling.

The announcement from Quantum Brilliance’s Chief Revenue Officer, Mark Mattingley-Scott, underscores the global implications of this milestone. He emphasized that the operationalization of QB-QDK2.0 at Fraunhofer IAF lays the foundation for broader adoption of nitrogen-vacancy (NV) center-based quantum processors, which hold promise for bringing quantum advantages to real-world applications in both industry and academia. The collaborative spirit driving this achievement reflects a growing synergy across Germany and Europe, poised to accelerate innovation in quantum computing technologies.

Installation and deployment were expertly supported by SVA System Vertrieb Alexander GmbH. Their extensive experience in high-quality IT solutions expedited the successful setup in May 2025, ensuring optimal integration with existing HPC infrastructure. This collaboration exemplifies the critical role of industry partnerships in transforming emerging quantum hardware from laboratory curiosities into mainstream scientific tools.

At the core of Quantum Brilliance’s technology lies the application of synthetic diamond substrates embedded with nanoscopic defects known as nitrogen-vacancy (NV) centers. These NV centers act as qubits—the fundamental information carriers of quantum computing—leveraging their unique quantum properties to encode and manipulate data with remarkable stability. Such diamond-based qubits boast inherently long coherence times, preserving quantum states far longer than many competing platforms, a critical factor enabling scalable and reliable quantum computation.

Moreover, NV center qubits exhibit exceptional resilience to environmental noise and thermal fluctuations, allowing these quantum processors to operate effectively at room temperature. This trait eliminates the necessity for complex refrigeration and isolation systems, drastically simplifying quantum infrastructure requirements. The ability to function in ambient conditions not only reduces operational costs but also opens avenues for integrating quantum technology into a broad spectrum of industrial applications without demanding specialized facilities.

Fraunhofer IAF’s quantum computing application laboratory serves as a dynamic incubator for leveraging these innovative diamond qubit systems. Alongside the QB-QDK2.0, the laboratory also features a complementary NV-based quantum system developed by the University of Stuttgart, fostering a collaborative research environment dedicated to optimizing algorithms and exploring novel uses of diamond quantum technology. Drawing inspiration from these installations, Fraunhofer IAF is actively engaged in developing its proprietary diamond quantum computer, signaling a robust commitment to pushing hardware frontiers further.

This strategically established infrastructure facilitates access to quantum computing resources for scientists and industrial professionals committed to exploring NV center technologies. The platform supports the refinement of quantum algorithms tailored to material-specific idiosyncrasies and empowers tackling complex computational challenges that classical machines struggle to address efficiently. Such practical exposure could accelerate breakthroughs in fields ranging from cryptography and optimization to quantum-enhanced sensing.

Following an initial test and validation phase, Fraunhofer IAF plans to open the QB-QDK2.0 system to its wider network of partners in both academic institutions and industry sectors. This approach amplifies access to cutting-edge quantum hardware within Baden-Württemberg’s thriving innovation ecosystem. Supporting this development is the QuantumBW initiative, the state’s ambitious quantum technology roadmap, which positions Baden-Württemberg as a global hub for quantum research particularly focused on diamond-based quantum platforms.

QuantumBW’s strategic emphasis on diamond quantum hardware aligns with Fraunhofer IAF’s ongoing efforts, fortifying Germany’s competitive edge in the rapidly evolving quantum landscape. The synergy between industry, research institutions, and innovation initiatives forms a powerful trifecta driving progress. By nurturing this ecosystem, Baden-Württemberg signals its determination to lead in developing scalable, energy-efficient, and commercially viable quantum computing solutions.

Fraunhofer Institute for Applied Solid State Physics IAF stands out as a world leader in semiconductor and diamond-based material research. Its comprehensive expertise spans the entire value chain from atomic-level material design and fabrication to complex device engineering. The institute’s portfolio includes pioneering developments in electronic circuits for next-generation communication, high-precision laser spectroscopy, quantum computing hardware, and industrial quantum sensors, exemplifying a holistic approach to future technologies.

Founded in 2019 in Australia and emerging from seminal research at the Australian National University, Quantum Brilliance epitomizes innovation in diamond quantum technology. The company’s mission centers on developing compact, rugged quantum accelerators capable of operating at room temperature, uniquely blending high performance with scalability and energy efficiency. These breakthrough devices, complemented by a suite of software tools, are gaining traction across the globe, reflecting a paradigm shift in how quantum computing hardware can be architected and utilized.

Quantum Brilliance’s full-stack approach integrates hardware and software development, fostering seamless interaction between quantum accelerators and classical computing infrastructure. With operational bases in Australia and Germany, the company is driving efforts to democratize quantum computing, enabling widespread deployment from everyday consumer devices to high-performance computing centers. This dual geographical footprint enables close collaboration with key academic and industrial partners, accelerating the pace of innovation.

As quantum computing inches closer to practical ubiquity, the deployment of robust, energy-efficient, and easily integrable quantum hardware such as Quantum Brilliance’s QB-QDK2.0 signals a transformative moment. By circumventing traditional limitations like cryogenic cooling and large-scale infrastructure demands, this technology facilitates a paradigm where quantum processors can seamlessly mesh with existing classical architectures, accelerating hybrid quantum-classical algorithms that promise to unlock new computational capabilities.

The pioneering integration at Fraunhofer IAF epitomizes this evolution, offering a versatile platform for exploring novel quantum applications and fostering cross-disciplinary research initiatives. As researchers and industry professionals gain practical hands-on experience with diamond-based quantum computing systems, the path toward scalable, reliable quantum solutions becomes clearer. Ultimately, these developments underscore the strategic importance of quantum technologies in shaping the next era of scientific discovery and industrial innovation.

Subject of Research: Quantum Computing, Diamond-Based Quantum Accelerators, Nitrogen-Vacancy Center Qubits, Hybrid Quantum-Classical Computing

Article Title: Fraunhofer IAF Integrates Quantum Brilliance’s Diamond-Based Quantum Accelerator into HPC Landscape

News Publication Date: May 2025

Web References:

• Fraunhofer IAF
• Quantum Brilliance

Image Credits: © Fraunhofer IAF

Keywords: Quantum computing, Quantum processors, Qubits, Quantum memory, Computer networking, Materials, Materials engineering, Solid state physics