The research, published in the International Journal of Intelligent Robotics and Applications, presents an integrated framework developed by Nikolaos Anatoliotakis and Panagiotis Koustoumpardis of the University of Patras, together with Paraskevi Zacharia of the University of West Attica. What makes their approach remarkable is its economy of hardware: a single robotic arm works alongside an unmodified industrial sewing machine, performing every manipulation task from grasping and rotating the fabric to holding it under precise tension while the needle runs at high speed. Most previous systems have tackled only isolated stages of the sewing workflow or relied on dual-arm setups and custom machinery.

The process begins the moment a piece of cloth is placed on the sewing machine bench. A fixed overhead camera captures an image of the workspace, which the system converts to grayscale, preprocesses, and binarizes to separate the fabric from its background. A clever two-kernel filtering scheme then scans the image with concentric square windows of three-by-three and five-by-five pixels to distinguish interior fabric pixels from outline pixels, filtering out noise caused by loose threads that would otherwise corrupt the detected boundary. The result is a clean set of boundary points that describes the fabric’s geometry with striking robustness, even when stray objects or lighting imperfections interfere.

Extracting an accurate contour is harder than it sounds, particularly for non-convex shapes with concavities that a single convex hull computation cannot capture. The researchers devised an iterative refinement strategy: the convex hull algorithm is applied to the full boundary, each resulting line segment is tested against the actual outline, and whenever a segment fails to represent the underlying shape, the hull is recomputed on the points between that segment’s endpoints. This process repeats until every segment accurately traces the fabric edge. Sewing trajectories are then generated by offsetting the extracted outline inward by the desired selvedge distance, producing candidate paths for both straight and curved seams without any predefined geometric model of the workpiece.

Knowing where to grasp the fabric is arguably the most human part of the problem. Experienced operators intuitively pick locations that allow stable manipulation and smooth rotation, yet no deterministic rule generalizes across arbitrary shapes and sizes. The team captured this implicit expertise by recording human demonstrations: for each training instance, two images were taken, one of the fabric alone and one with the operator’s hand placed on it. Image subtraction isolated the hand region, from which a representative grasp point was extracted as ground truth. A feed-forward neural network with two hidden layers of 64 neurons and ReLU activations was then trained on the coordinates of up to 30 outline points, learning to predict grasp locations directly from fabric geometry.

The trained network’s performance is impressive for such a compact model. Across 20 unseen test samples spanning convex and non-convex contours of varying sizes and aspect ratios, the average deviation between predicted and human-selected grasp points was approximately 3.24 millimeters, with about 3 millimeters of error along the x-axis and 2.3 millimeters along the y-axis. When a practical tolerance of plus or minus 4 millimeters was applied, 85 percent of predictions fell within range, and the predicted grasp points enabled successful fabric positioning in roughly 93 percent of manipulation trials. The researchers note that accuracy depends on how visually similar new fabrics are to the training set, underscoring the need for larger and more diverse datasets as the approach scales.

With the grasp point chosen, the robot must align the fabric beneath the needle before stitching can begin. The system computes the angular deviation between the initial segment of the selected sewing path and the sewing machine’s axis, then applies a coordinated sequence of rotational and translational movements so that the starting point sits precisely under the needle with the initial seam segment parallel to the sewing direction. Throughout positioning, a force controller regulates the interaction between the gripper and the workbench, maintaining a constant normal force that prevents slippage and unintended deformation while establishing appropriate tension for the sewing phase ahead.

During sewing itself, three feedback controllers operate in parallel. A camera mounted roughly 80 millimeters above the needle captures a 50 by 40 millimeter field of view around the stitch point, allowing two vision-based controllers to work simultaneously: one compensates the lateral deviation between the needle and the fabric outline, while the other measures local orientation using two parallel virtual scan lines ahead of the needle and applies corrective rotations. Meanwhile, a six-axis force/torque sensor mounted between the gripper and the robot flange feeds a tension controller that keeps the fabric at a reference force of 2 newtons, enough to stabilize the material without causing damage, wrinkles, or excessive stretching. The lateral and orientation corrections are summed into a single control command, exploiting the natural coupling between position and orientation in planar fabric manipulation.

The experimental validation covered fabrics ranging from 180 by 120 millimeters to 300 by 220 millimeters, including medium-stiff cotton, lightweight knit, denim-like composites, and layered materials, all sewn at 45 percent of the machine’s maximum 1800 stitches-per-minute speed, corresponding to a fabric feed velocity of about 84 millimeters per second. Across all trials, seam deviation stayed within plus or minus 2.5 millimeters, with an average of approximately 1.2 millimeters, a standard deviation of 0.9 millimeters, and 79 percent of seam points falling inside the desired offset tolerance. Even layered fabrics with higher friction and deformation resistance were sewn with consistent trajectory tracking, confirming that the tension controller maintained the target force despite increased material stiffness.

The implications for the textile industry, which still relies overwhelmingly on skilled human operators, are substantial. Rather than replacing only one subtask, this framework integrates fabric detection, contour extraction, trajectory generation, grasp point estimation, alignment, tension regulation, and seam execution into a unified workflow compatible with standard industrial equipment. Limitations remain, including modest user intervention for fabric placement and sewing-path selection, and the grasp estimator’s dependence on representative training data. But the work demonstrates convincingly that combining perception, learning, and coordinated vision-and-force control can push robotic sewing toward the autonomous, flexible textile manufacturing that has long eluded the field.

Subject of Research: An integrated robotic sewing system for flexible fabric manipulation using computer vision, learning-based grasp point estimation, and vision- and force-based control

Article Title: A Robotic sewing system for flexible fabric manipulation using computer vision, learning-based grasping and force control

Article References: Anatoliotakis, N., Zacharia, P., & Koustoumpardis, P. (2026). A Robotic sewing system for flexible fabric manipulation using computer vision, learning-based grasping and force control. International Journal of Intelligent Robotics and Applications. https://doi.org/10.1007/s41315-026-00590-3

Image Credits: AI Generated

DOI: 10.1007/s41315-026-00590-3

Keywords: robotic sewing, fabric manipulation, computer vision, neural networks, grasp point estimation, force control, seam tracking, deformable objects, textile automation, SCARA robot, vision-based control, intelligent manufacturing

The review systematically organizes the literature along four axes: the learning paradigm used, the sensing modality feeding the robot, the control strategy governing motion, and the training environment in which the policy is developed. This taxonomy matters because peg-in-hole insertion sits at the intersection of nearly every hard problem in robotics. The task demands sub-millimeter precision, compliance under contact, robustness to uncertainty, and fast reaction times, all at once. Robots programmed with fixed trajectories and remote center of compliance devices, the traditional solution, struggle when tolerances tighten or parts deviate from nominal specifications. Reinforcement learning offers an alternative: instead of hand-coding every motion, the robot learns a policy by trial, guided by rewards that favor successful insertion and penalize damaging contact forces.

At the foundation of the field lie classical algorithms such as Q-learning and SARSA, which estimate the long-term value of actions in discrete state spaces. These methods, reviewed alongside foundational surveys of reinforcement learning in robotics, work well for simplified insertion problems but collapse when the state space explodes to include continuous joint positions, contact forces, and camera images. The arrival of deep reinforcement learning changed the equation. By using deep neural networks as function approximators, frameworks such as deep deterministic policy gradient methods can map raw sensory inputs directly to continuous control actions, learning insertion strategies that adapt to the subtle force signatures of jamming, wedging, and misalignment. The review highlights landmark demonstrations, including deep reinforcement learning systems for industrial insertion tasks with visual inputs and natural rewards, and the InsertionNet line of work that scaled solutions to diverse insertion geometries.

Sensing is where much of the practical magic happens, and the review devotes particular attention to multimodal perception. Vision alone, whether from RGB cameras or depth sensors, provides coarse alignment but fails when the peg enters the hole and occlusion sets in. Force and torque sensing at the wrist captures the contact dynamics, while tactile sensors on the gripper fingers add another layer of information about slip and localized pressure. Studies combining haptic and vision fusion for accurate position identification in multi-peg assembly, vision-force-fused curriculum learning for contact-rich tasks, and impedance-based sim-to-real transfer learning driven by multiple modalities all point to the same conclusion: fusing complementary senses produces insertions that are faster, safer, and more general than any single modality can deliver. Hybrid frameworks that combine reinforcement learning with imitation learning and classical control, such as variable compliance control learned through deep reinforcement learning, further improve robustness and training efficiency by letting established control theory handle stability while learning refines the strategy.

Training these policies in the real world is expensive and risky, which is why the sim-to-real gap dominates the field’s technical conversation. Simulators allow millions of virtual insertion attempts, but a policy that succeeds in simulation often fails on a physical robot because simulated contact physics never perfectly matches reality. Two families of techniques dominate the mitigation strategies reviewed. Domain randomization deliberately varies physical parameters, lighting, friction, and geometry during training so the learned policy becomes robust to the mismatch; newer work even frames domain randomization as an entropy maximization problem. Transfer learning and domain adversarial approaches, meanwhile, adapt representations learned in one domain to another. The review also documents the rise of digital twin technologies, in which high-fidelity virtual replicas of physical production cells, demonstrated in contexts ranging from FANUC robot programming to autonomous driving training, allow continuous policy refinement against a model that is kept synchronized with the real system.

Sample efficiency remains a central bottleneck, and the review catalogs the strategies researchers have invented to squeeze more learning from fewer trials. Meta-reinforcement learning trains policies that can rapidly adapt to new peg and hole geometries with minimal additional experience, with applications demonstrated for industrial insertion tasks and offline meta-learning variants that learn from previously collected datasets. Curriculum learning progressively increases task difficulty, for example starting with generous chamfered clearances before moving to tight chamferless holes. Model-based reinforcement learning accelerates learning by exploiting learned dynamics models, an approach validated for high-precision robotic assembly. Pre-training methods based on geometric feature representations give policies a useful inductive bias before any insertion attempts begin, and demonstration-based imitation provides a warm start that pure trial-and-error cannot match.

The comparative analysis of representative studies assembled in the review reveals clear trends. Force-based control strategies with learned components consistently outperform purely position-controlled approaches on tight-tolerance tasks. Vision-guided policies paired with force feedback dominate recent publications, and transformer-based reinforcement learning architectures are beginning to appear as a way to handle long-horizon contact sequences and richer observations. Uncertainty-aware strategies, such as spiral search trajectories driven by learned uncertainty estimates, illustrate how probabilistic reasoning is being folded into otherwise deterministic control pipelines. Yet the authors are candid about the limitations that still block widespread industrial adoption: sample inefficiency, fragile generalization to unseen geometries, safety concerns when learning systems touch expensive tooling, poor interpretability of learned policies, and the engineering complexity of deploying and maintaining these systems on real production lines at scale.

The forward-looking sections of the review sketch a research agenda that reads like a roadmap for the next generation of assembly robots. Multimodal learning that integrates vision, force, and touch in unified models is expected to deepen. Digital twin-assisted training promises continuous lifelong learning as factory conditions drift. Hybrid control architectures that blend reinforcement learning with impedance or admittance control offer a path to certified safety. Multi-agent reinforcement learning points toward teams of robots cooperating on complex multi-part assemblies, and real-time edge deployment aims to run learned policies on embedded hardware with the deterministic latency that industrial controllers demand. Each of these directions is grounded in recent literature the review documents, from swarm robotics applications to transformer-based policy representations.

What emerges from this exhaustive synthesis is a field in rapid, disciplined maturation. Peg-in-hole insertion, once a benchmark problem pursued largely in laboratories, is becoming a proving ground for the techniques that will let robots handle the messy, contact-rich reality of manufacturing. The review consolidates a decade of progress into a structured reference, showing researchers precisely which combinations of learning paradigm, sensing, control, and training environment have been tested, which have succeeded, and where the open problems lie. For an industry under pressure to automate ever finer assembly work, from electronics to aerospace structures, the message is clear: the robots are not just being programmed anymore. They are learning to feel their way, one careful insertion at a time.

Subject of Research: Reinforcement learning approaches for robotic peg-in-hole insertion in industrial assembly

Article Title: A comprehensive review of reinforcement learning approaches in peg-in-hole insertion for robotic assembly tasks

Article References: Shoura, A. A., Awad, M. I., Maged, S. A., & Fattah, D. E. A. (2026). A comprehensive review of reinforcement learning approaches in peg-in-hole insertion for robotic assembly tasks. International Journal of Intelligent Robotics and Applications. https://doi.org/10.1007/s41315-026-00575-2

Image Credits: AI Generated

DOI: 10.1007/s41315-026-00575-2

Keywords: reinforcement learning, peg-in-hole insertion, robotic assembly, deep reinforcement learning, sim-to-real transfer, multimodal perception, force control, visual servoing, digital twin, meta-reinforcement learning, domain randomization, industrial robotics