Content area
Three-dimensional (3D) localization of magneto-surgical devices is essential for safe and efficient navigation. However, existing magnetic localization methods either limit device miniaturization due to internal sensors or require additional excitation fields and external sensor arrays. Herein, we formulate a localization method based on the special properties of rotating magnetic dipoles, which allow reconstruction of position and rotation axis from a single external tri-axial magnetometer. The rotating dipole is realized through a permanent magnet synchronous motor (PMSM) that can reversibly (un)lock using the heat-induced phase transition of a low melting point alloy. Sequential localization and manipulation is performed by an external mobile electromagnet equipped with a single eye-in-hand Hall effect sensor. We describe the PMSM’s thermal and magnetic properties, formulate the governing localization equations, quantify and validate 3D tracking of PMSM pose trajectory, and demonstrate sequential localization and manipulation in a benchtop experiment.
Richter et al. present a localization method to determine the 3D position and rotation axis of rotating magnetic dipoles. The authors demonstrate this method for tracking of a millimeter-scale motor in the context of vascular navigation.
Introduction
Collaboration between localization and manipulation systems is important for safe and efficient deployment of magnetic continuum robots1,2 during diagnostic and therapeutic interventions3. Recent clinical demonstrations have shown the potential of these robots to navigate tortuous environments under magnetic manipulation4, 5, 6–7. Meanwhile, traditionally large stationary manipulation systems8,9 are being downsized for greater mobility and reduced floorspace, moving toward commercialization10, 11, 12–13. These systems generate targeted magnetic fields toward manipulation of robots in vivo, which is facilitated by localization systems that reconstruct relative three-dimensional (3D) position and orientation information essential for control14,15. In this regard, localization connects manipulation systems to microsurgical devices.
Conventional medical localization methods use technologies like stereo vision14,16, biplane fluoroscopy17,18, angulated C-arm fluoroscopy19,20, ultrasound21, 22, 23–24, or magnetic resonance imaging systems25, 26–27. These methods are compatible with various types of microrobots and offer various spatial and temporal resolutions, penetration depths, and sizes of infrastructure28. However, closed-loop magnetic manipulation is challenging due to often unknown coordinate transformations between physically disconnected reference frames of imaging and magnetic manipulation systems29.
Alternatively, low-field localization methods (here defined in the nano- to milli-Tesla range), enable the development of magnetic tracking and manipulation systems that are independent of conventional medical imaging technologies30. These methods rely on detecting magnetic fields and reconstructing the relative pose of the field source31. They typically involve external magnetic field sources combined with internal sensorized devices32, 33–34 or magneto-mechanical resonators with external magnetometer arrays35,36.
Sensorized magnetic devices, often equipped with a single tri-axial magnetometer37, 38, 39–40, can be localized relative to, and manipulated by, external field generating hardware30,33. However, device miniaturization is limited by the space required for the sensor and the need for a rigid magnet-sensor connection to prevent saturation and maintain a consistent local field30. Alternatively, resonators offer better miniaturization potential by using a single magnet for both localization and manipulation, but they require targeted excitation fields and external magnetometer arrays to measure oscillating fields36. Increasing numbers of stationary magnetometers are required to expand the localization workspace when physically decoupled from magnetic manipulation systems41,42. This solution may have practical limitations in clinical settings. Alternatively, integration of external eye-in-hand magnetometers attached to mobile magnetic field generating systems provides connected mobile localization and manipulation workspaces43.
In this work, we demonstrate a localization and manipulation approach that combines the benefits of sensorized devices, magneto-mechanical resonators, and eye-in-hand magnetometers. These include minimizing the required number of magnetometers, generating alternating fields in vivo, and integrating electromagnetic localization and manipulation workspaces. Our method is based on rotating magnetic dipoles, which produce fields with elliptically varying strength at any point in space44. These fields provide four possible solutions to the pose of a rotating field source, based on measurements from a single tri-axial magnetometer32. Herein, this ambiguity is resolved using a priori knowledge of a rotating dipole position, obtained with closed-loop position feedback. The reconstructed dipole pose may be used to inform targeted generation of magnetic fields by a manipulation system.
As the rotating dipole, a milli-scale permanent magnet synchronous motor (PMSM) is developed (Fig. 1a). The motor includes planar-coil inspired45 electromagnetic stators and a permanent magnet rotor. A ferrofluid bearing is used as an antifriction mechanism and ensures concentricity of the rotor and stator (Supplementary Movie 1). This bearing is inspired from other small-scale linear46 and rotary motors47,48, as low-cost and complexity alternatives to dry-film lubricants49, jewel bearings50, or micro-ball bearings51.
Fig. 1 [Images not available. See PDF.]
Schematic illustration of the permanent magnet synchronous motor (PMSM) for localization and manipulation.
a Motor dimensions and components. The PMSM consists of two stators, which are made up of two planar coils wrapped cylindrically around a permanent magnetic rotor with a ferrofluid bearing. b A fusible low melting point alloy (LMPA) fills the rotor cavity and functions as a rotor locking mechanism. The heat and field produced by the stators simultaneously induce LMPA liquefying and rotor rotation, respectively. c The rotor generates a rotating magnetic field, which is detected by a single Hall effect sensor. These field measurements are used to determine the three-dimensional position and rotation axis of the motor. d When the LMPA solidifies, it locks the rotor in its orientation, enabling the motor to be steered in an external field by manually rotating the tether.
In order to demonstrate localization and manipulation of PMSMs, we introduce a rotor locking mechanism to the PMSM (Fig. 1b). This mechanism is inspired from the thermal and reversible solid-liquid phase transition of low melting point alloys (LMPA)52, 53. Here, the stators of the PMSM act as heat and field sources54 to induce LMPA liquefying and rotor rotation, respectively. The unlocked rotor (localization mode) allows reconstruction of the PMSM pose by an external magnetometer; the locked rotor (manipulation mode) allows the PMSM to act as a static permanent magnet able to be manipulated by external fields.
The external field source comprises an electromagnetic coil22 equipped with an eye-in-hand tri-axial Hall effect sensor, for iterative magnetic manipulation and localization of the PMSM, respectively (Fig. 1c). Similar to the PMSM, the external system exhibits mode-switching. In localization mode, with the electromagnet deactivated and sensor/PMSM active, rotating fields from the PMSM are used to reconstruct its pose and reposition the coil. In manipulation mode, with the electromagnet activated and sensor/PMSM deactivated, the PMSM is mechanically rotated and displaced for steering (Fig. 1d).
The fabrication process of the PMSM, the characterization of its thermal and magnetic properties, as well as the validation of the LMPA-based locking mechanism, are described. Governing equations are formulated for the localization of rotating magnetic dipoles with perpendicular axes of magnetization and rotation. Quantitative experiments evaluate localization accuracy along 2D and 3D trajectories of the PMSM. Finally, a benchtop experiment demonstrates localization and manipulation of the PMSM in a tubular network, using an external integrated electromagnetic coil and eye-in-hand Hall effect sensor.
Results
Permanent magnet synchronous motor
Figure 2a illustrates the fabrication process and main components of the presented PMSM, comprising cylindrical stators made of two planar electromagnetic coils (Supplementary Fig. 1), a diametrically magnetized cylindrical rotor with ferrofluid bearing, an LMPA rotor lock, a polyvinylidene fluoride (PVDF) heat shrinkable tube stator holder, a polytetrafluoroethylene (PTFE) tether guiding power leads, and a resin shell/seal preventing LMPA leakage (cross-sectional views are provided in Supplementary Fig. 2).
Fig. 2 [Images not available. See PDF.]
Permanent magnet synchronous motor (PMSM) components and assembly.
a Fabrication of the PMSM. (i) Schematic of two stacked planar coils and a cross section with annotated dimensions. (ii) Planar coils are rolled into cylindrical stators with perpendicular angular orientation (θ). A PVDF tube maintains the shape and connects to a PTFE tube, guiding power leads. (iii) An injected low-friction resin seals the proximal opening of the stator lumen. (iv) The stator lumen is filled with a solid cylinder of Cerrolow 117 alloy. (v) The cylinder is molten, followed by inserting a diametrically magnetized rotor with a ferrofluid bearing. (vi) The liquid alloy is pushed up by inserting the magnet, and cooled to solidify. (vii) The motor is sealed with a resin dip coating. b Photographs of the stator structure and lumen. c Front and back views showing coil edge alignment when wrapped. d Top-view and isometric photographs of the stator lumen with the rotor and fusible alloy, and finished PMSM. Scale bar: 2 mm.
Figure 2b shows the fabricated stator structure, including the PTFE tether, PVDF heat shrink, stators, and rotor cavity. A top view presents the cylindrical stator coils held by the PVDF tube, with the internal rotor cavity displaying the meandering copper strands of the coils. Figure 2c provides front and back side views of the stator. Meandering copper strands trace a cylindrical path and align at diametrically opposite positions, resulting in superposition of magnetic flux densities. Figure 2d depicts the rotor magnet inside the rotor cavity (north pole marked in red), the fusible alloy contained in the rotor cavity, and an isometric view of PMSM with the outer resin shell.
Motor properties
Stator magnetic field
A finite element model (FEM) of the stator structure simulates the electromagnetic field within the PMSM’s rotor. In the stator coils, longitudinal copper strands generate a magnetic field in the diametric direction, while radial strands produce a field in the longitudinal direction. The magnetic field strength of the inner stator within the rotor volume ranges from 3 mT A−1 to 6 mT A−1 (Fig. 3a), assuming linearity between the generated field and electric current. Further, with quadrature sinusoidal currents through the inner and outer stator, average field strengths of 3.9 mT A−1 and 3.6 mT A−1 are achieved in perpendicular directions (Fig. 3b). The difference is due to the different inner diameters of the stators.
Fig. 3 [Images not available. See PDF.]
Characterization of magnetic, thermal, and frequency properties.
a, b Simulated stator magnetic field (b = 〈bx, by, bz〉) distribution in the rotor volume from quadrature unit-currents (Iinner, Iouter). c Measured internal and surface temperatures from 200 mA quadrature currents in room-temperature air (18 °C) and heated water (~37 °C). d Rotor field strength along its magnetization axis. e, f Field and gradient norms in the magnetization plane (magnetization and rotation axes). g Unlocking rotor rotation by phase transition of fusible alloy during stator activation. h Frequency analysis of rotor field signal during unlocked state. i Frequency analysis for motor frequencies up to 10 Hz, confirming synchronous rotation.
Stator heating
Temperature changes due to resistive heating and passive cooling of the stators, were measured at room temperature (18 °C) and in a bath of stationary heated water (~37 °C) using a thermocouple positioned internally or on the external surface (Supplementary Fig. 3). During heating, quadrature currents were applied to the inner and outer stator coils with current amplitude I = 200 mA and unit frequency (fm = 1 Hz), over t ∈ [0, 120] s. During cooling (t ∈ [120, 180]), currents were switched off. The quadrature current results in an electric power of P = 0.165 W, steady-state lumen temperatures of Tinternal ∈ {49, 50} °C, and PMSM surface temperatures of Texternal ∈ {31, 40} °C, in air and water, respectively (Fig. 3c).
Rotor magnetic field
The 3D magnetic field around the PMSM is modeled and scaled using field measurements from a Hall effect sensor (Fig. 3d–f). One-dimensional (1D) field measurements were taken by positioning the motor at varying distances (x ∈ {10, 20, 30, 40} mm) above the sensor (Supplementary Fig. 4). The measured rotor field strengths (b(x) ∈ {411, 55, 18, 7} μT) corresponds to the maximum field strength where the rotor’s magnetization axis is coincident with the sensor. These measurements were taken during rotor rotation. Static background fields and noise were averaged out during signal processing.
The 1D measurements are validated by comparison to a dipole approximation model, and thereafter used to scale a 3D finite element (FE) field model (Fig. 3d). This numerical FE model estimates magnetic fields around the rotor magnet. These estimates are used to fit an analytical 3D multipole expansion model (see “Materials and methods,” R2 = 0.999). Finally, this model and its spatial derivatives provide field strengths and gradients in the rotor’s magnetization plane (Fig. 3e, f). We note that the general multipole expansion model may be interchanged for a simpler dipole approximation for modeling fields at sufficient distances from the rotor magnet55.
Rotor locking alloy
The rotor locking mechanisms comprise a fusible alloy with a solid-liquid phase transition at 47 °C that melts due to resistive heating from the stators (Fig. 3g and Supplementary Movie 2).
Rotor unlocking is validated by positioning a Hall effect sensor above the motor, activating the stators with quadrature currents of I = 175 mA amplitude and fm = 0.25 Hz frequency, and measuring the magnetic field over 60 s. During the phase transition (t ∈ [0, 45] s), the rotor field varies sinusoidally with temporally increasing amplitude. Once fully liquefied (t > 45 s), the rotor rotation is synchronous with the stator field. The duration until complete phase transition is consistent with the temperature elevation corresponding to the amplitude of quadrature current (Fig. 3c).
Motor rotation frequency
The rotor’s synchronous rotation at the set motor frequency (fm = 0.25 Hz) is confirmed via frequency analysis of the field signal after liquefying of the alloy (Fig. 3h). Synchronous rotation is also validated across a range of frequencies (fm ∈ {1, 2, . . . , 10} Hz), with the upper limit imposed by the maximum sampling frequency (fs = 20 Hz) of the Hall effect sensor (Fig. 3i). In addition, a video recording shows rotor rotation up to a frequency of 10 Hz (Supplementary Movie 1).
Magnetic localization
The proposed localization method matches measured to modeled rotating field properties of the rotor within its magnetization plane. This plane is defined by the rotor’s rotation axis and magnetization axis , and contains 2D ellipse-shaped field isolines of uniform strength (Fig. 4a).
Fig. 4 [Images not available. See PDF.]
Formulation of rotor field isoline functions.
a Magnetic field isolines and arrows in the rotor’s magnetization plane (magnetization and rotation axes). b Field isolines are 2D cross-sections of tri-axial ellipsoidal field isosurfaces, which rotate about a motor rotation axis with an angle (ϕ) during activation. c In situ rotation of field ellipsoidal isosurfaces generates rotating fields (b(p, ϕ)) at any position (p), which itself forms an ellipse with principal axes defined by the maximum and minimum field strengths . d Schematic representation of the magnetization plane, with an isoline ellipse traced by a position (pe(biso, β)) defined by the isoline field strength (biso) and position angle (β) from the magnetization axis . Any isoline position (pe) is additionally associated with vectors of maximum field , minimum field , field rotation axis , and scalars of field ratio and field angle . A 3D representation is provided in Supplementary Fig. 5. e Analytical function fit to isoline position vectors , showing distances from the rotor magnet to isoline positions. f Analytical function fit to field ratio and field angle , considering that α(β) = α(biso, β) ≡ α(pe).
The 2D isolines are cross-sections of 3D tri-axial ellipsoids of constant field magnitude (biso), which rotate with the rotor by an angle (ϕ) about (Fig. 4c). The field (b(p, ϕ)) at any position changes in strength and direction synchronous to ϕ. Maximum field strength occurs when p coincides with the smallest isoline in the magnetization plane , where . Minimum field strength occurs at a quarter turn . The ratio of maximum to minimum field strength defines the field ratio . Further, the field (b(p, ϕ)) rotates within a plane around the field rotation axis and forms an ellipse with principal axes (Supplementary Fig. 5).
These field properties apply to any position in space, which periodically coincides with an isoline in the magnetization plane. Therefore, field properties can be linked to isoline positions. Next, we formulate “rotor field isoline functions" to describe the relationship between rotating field properties and corresponding isoline positions.
Rotor field isoline functions
A 2D isoline in the rotor’s magnetization plane is defined by field strength (biso) and position angle (β). We define an isoline position vector (pe(biso, β)) that traces the ellipse-shaped path, and that corresponds to a maximum field , minimum field , field rotation axis , field ratio , and field rotation angle (α(pe)) between the field’s rotation axis and the rotor’s magnetization axis (Fig. 4d and Supplementary Fig. 5).
The rotor field isoline functions depend on (a subset of) isoline variables {biso, β}, and include position (pe(biso, β)), field ratio (bratio(β)), and field angle (α(β)). These three isoline functions are formulated based on simulated values from the magnetic field model of the rotor. The isoline functions show that the isoline position distance (∥pe(biso, β)∥) varies elliptically along along each isoline (Fig. 4e). Also, bratio ∈ [1, 2] is cyclic and bounded along each isoline (also see Supplementary Text 1), with four possible solutions for β ∈ {β1, π−β1, π + β1, −β1}, β1 ∈ [0, π/2] (Fig. 4f). Similarly, α(β) ∈ [0, π] is cyclic and bounded. In this work, the ambiguity of β is resolved by using a priori knowledge of rotor position through closed-loop feedback of previous localizations (Eq. 14 and Fig. 8d).
Notably, the magnetic field of the stators is ignored during the formulation of the isoline functions. Upon synchronous rotation of the rotor’s magnetization axis with the stator field, we assume that the stator only acts to amplify the PMSM’s magnetic moment. In that case, although the PMSM’s field strengths shift for some pe, its does not. Since ∥pe∥ depends on , this is the only theoretically affected isoline function (Eq. 9). However, given the stator field’s weakness compared to that of the rotor (Supplementary Fig. 6), its impact on is considered negligible.
Magnetic localization algorithm
Magnetic localization of the PMSM is informed by field measurements taken by a Hall effect sensor at some position in space around the PMSM. These measurements are used in the rotor field isoline functions to compute the sensor’s isoline position in the rotor’s magnetization plane. Then, the position and rotation axis of the PMSM are determined using both the measured field components and the reconstructed isoline parameters (Supplementary Fig. 7). Figure 5a shows the localization setup, with a Hall effect sensor and PMSM. The goal is to reconstruct the motor’s position (Spm) and rotation axis (Sωm) relative to the sensor frame ({S}).
Fig. 5 [Images not available. See PDF.]
Schematic representation of the magnetic localization algorithm.
a Setup with a Hall effect sensor and its local Cartesian axes , and motor with position (Spm) and rotation axis (Sωm) relative to the sensor. b Temporal field measurements (Sb(t)) are compensated for the Earth’s field to obtain the motor field signal (Sbm(t)). This signal forms an ellipse with principal axes equal to vectors of maximum and minimum strength , and a normal vector equal to the field’s rotation axis . c The rotor’s magnetization plane is spanned by and , with perpendicular. d A rotation matrix associated with the rotation vector is defined with a skew-symmetric matrix. Isoline parameters are matched to the measured field ratio (Sbratio), yielding solutions for the isoline position angle (Sβ), position vector (Spe), and field angle (Sα). These parameters are used to reconstruct the motor pose.
Figure 5b illustrates field measurement post-processing. Temporal field measurements (Sb(t)) consist of the static Earth’s field, rotating PMSM field, and sensor noise. The Earth’s field is obtained through frequency analysis and subtracted from the measurement signal, giving the motor’s field (Sbm(t)). Then, a vector plot of Sbm(t) shows formation of a 3D ellipse in the reference frame of the sensor , characterized by a normal vector equal to the field’s rotation axis (Sωb), and principal axes representing vectors of maximum and minimum field strength . This additionally gives the field ratio .
Figure 5c again visualizes Sbm(t) in the sensor’s reference frame, including the reconstructed , , and . By definition, the rotor’s magnetization plane is spanned by and . Therefore, is perpendicular to the magnetization plane. The vector of maximum field strength is coincident and parallel to the magnetization plane, and identifies the isoline field strength .
Figure 5d shows the method of matching field measurements to an isoline position in the magnetization plane, followed by reconstruction of the motor pose relative to the sensor. A non-unique isoline position angle (Sβ ∈ {Sβ1, Sβ2, Sβ3, Sβ4}) is computed by minimizing the difference between measured and modeled field ratios. This leads to an associated isoline position (Spe(biso, Sβ)) and field angle (Sα(Sβ)). Finally, the relative motor position (Spm) and rotation axis are found by rotating the reconstructed field rotation axis around the perpendicular rotation vector by a function of isoline angles ({Sβ, Sα}) scaled to coefficients (c1, c2 ∈ {−1, 1}). These combinations of coefficients represent the four possible solutions for Sβ and can be obtained through optimization based on a priori knowledge of motor position, or triangulation with an additional sensor.
Magnetic localization validation
Magnetic localization is validated by moving the PMSM relative to a fixed Hall effect sensor using a robotic arm (Supplementary Fig. 4 and Supplementary Movie 3). The PMSM is displaced such that the sensor traces field isoline positions (pe(biso, β)) of chosen isoline field strength (biso) and position angle (β) in the motor frame (Fig. 6a and Supplementary Movie 3). Known motor-robot-sensor transformations give the associated reference motor position (pm) and rotation axis relative to the sensor. At each pe, field measurement-based reconstruction of motor position (Spm) and rotation axis is performed (Fig. 6b). During localization, the PMSM is activated at a motor frequency of fm = 1 Hz for 30 s, with field measurements taken at the upper limit of our sensor sampling frequency (fs = 20 Hz).
Fig. 6 [Images not available. See PDF.]
Magnetic localization of the permanent magnet synchronous motor (PMSM).
a Experimental setup with a stationary Hall effect sensor and movable PMSM by a robotic arm. PMSM displacement moves the sensor along isoline positions (pe(biso, β)) of specific field strength (biso) and position angle (β). Real motor positions and rotation axis are known and compared to the measurement-based reconstructed motor pose. b Experimental procedure for magnetic localization. c Localization results for different isoline field strengths (biso ∈ {6, 10, 20, 50, 100} μT) and position angles (β ∈ [0, 90]°), including (i) field strength, (ii) signal-to-noise ratio, (iii) theoretical difference in maximum and minimum field strengths, (iv) error between expected and reconstructed field ratio, (v) angular error in position angle, (vi) angular error in field angle, (vii) distance error in motor position, (viii) angular error in motor position vectors. (ix) Angular error in motor rotation axis.
Figure 6c shows localization results for isoline positions defined by various combinations of position angles (β ∈ {0, 7.5, 15, . . . , 90}°) and field strengths (biso ∈ {6, 10, 20, 50, 100} μT). The field strengths correspond to motor-sensor distances . The tracing of isolines by the sensor is validated through the maximum measured motor field strength (Fig. 6c(i)). The weakest isoline field strength (biso = 6 μT) corresponds to the lower boundary of signal-to-noise ratio (SNR ≥ 10 dB) for which we obtained consistent localization results (Fig. 6c(ii)).
Sensor noise, measured to be between 2 and 4 μT (Supplementary Fig. 6), determines whether the maximum and minimum field strength can be reliably differentiated (Fig. 6c(iii)). For those positions where , errors in reconstructed field ratio are ∣Sbratio−bratio∣ ≤ 0.12 (Fig. 6c(iv)). The error in Sbratio determines the error in isoline position angle (Fig. 5d and Eq. 8) as ∣Sβ−β∣ ≤ 23° (Fig. 6c(v)), and isoline field angle as ∣Sα−α(β)∣ ≤ 10° (Fig. 6c(vi)). Finally, localization accuracy in distance offset is ∥pm−Spm∥ ≤ 7 mm (Fig. 6c(vii)), and for directionality vectors of motor position (Fig. 6c(viii)) and rotation axis (Fig. 6c(ix)).
In order to analyze the angular errors in and , consider that both equally depend on those in reconstructed field vectors , seen in the governing localization equations (Fig. 5d and Eqs. 11–13). Further, depends on Sα, whereas depends on {Sβ, Sα}. Also, Sα depends on Sβ, that depends on Sbratio. From the partial derivatives of the isoline parameters, we observe that ∣∂α(β ≤ 60°)/∂β∣ ≤ 1 and mitigates errors in Sβ, but amplifies above (Supplementary Fig. 8). This is seen from the peaks at β = 23° and β = 65° (Fig. 6c(v), (vi)). Also, ∣∂β/∂bratio∣ and ∣∂α/∂bratio∣ are most sensitive to errors at the boundary of bratio(β) ∈ {1, 2}, and least sensitive when bratio(β) ∈ [1.1, 1.9]. This corresponds to the relative motor-sensor configurations with isoline position angles of β ∈ [25, 75]° (Fig. 4f).
Angular errors in expectedly to increase with β, for which falls below the sensor noise, and reconstructed components of the measured field become less accurate. Unexpectedly, however, the error ∣Sβ−β∣ increases linearly with β ≤ 23° (Fig. 6c(v)). This error stems from an overestimation of Sbratio ≈ 2, ∀β ≤ 23°, which is observed for all field strengths and appears unrelated to the SNR (Fig. 6c(iv)). A potential cause is observed in , ∀β ≤ 23° (Fig. 6c(iii)), that indicates a region where changes in relative maximum and minimum field strengths are indistinguishable from sensor noise.
Three-dimensional trajectory tracking
The three-dimensional tracking of motor pose is demonstrated along cubic (Fig. 7a), helical (Fig. 7b), and sinusoidal paths (Fig. 7c). Each trajectory consists of a series of predetermined positions (pm = 〈pm,x, pm,y, pm,z〉) and rotation axes with respect to the sensor. These poses are iteratively traced by the PMSM using a robotic arm (Fig. 6a and Supplementary Movie 3). At each iteration, the motor’s position (Spm) and rotation axis are reconstructed. At the first iteration, the known motor position (pm) is used as the initial guess to compute Spm. In subsequent iterations, the previously reconstructed Spm is used as feedback (Supplementary Fig. 7).
Fig. 7 [Images not available. See PDF.]
Tracking of the permanent magnet synchronous motor (PMSM) in 3D.
Results show motor position (pm, dots) and rotation axis with respect to the sensor frame, for a cubic, b spiral, and c sinusoidal paths. Error bars represent standard deviations with the associated number of samples annotated above each bar.
Figure 7 reports absolute sensor-to-motor distance (∥pm∥) along each trajectory, localization distance error (∥pm−Spm∥), measured maximum field strength , and reconstructed isoline position angle (Sβ). Additionally, for all isoline position angles (β) along each trajectory, the angular errors in position angle (Sβ−β), and PMSM directionality vectors for position (∠pm, Spm) and rotation axes , are shown.
The tracking results support previous findings that localization is most accurate for β ∈ [25, 75]° (Fig. 6). Angular errors in position vectors are found to be within pm, Spm ∈ [5, 15]°, whereas for rotation axis within . Localization errors increase for β < 25°, possibly due to a region of low sensor accuracy and precision.
Errors and standard deviations in likely stem from incorrect optimization of the localization coefficients {c1, c2} (Eq. 14). Figure 7 (central panels) shows abrupt deviations in the reconstructed position, indicating a series of faulty localizations. These errors persist due to feedback to subsequent localization iterations (Supplementary Fig. 7). Since {c1, c2} are optimized based on prior positions, the position angular error (pm, Spm) changes less between iterations. However, an incorrect sign of c2 = ±1 already introduces a 90° error in (Eq. 13), with the potential for variation in angular errors between iterations.
Magnetic localization and manipulation
Iterative magnetic localization and manipulation of the PMSM is demonstrated in a 2D tubular network (Supplementary Fig. 9 and Supplementary Movie 4). The experimental setup includes an integrated external localization-manipulation system comprising a Hall effect sensor mounted on the tip of an electromagnet, serving as the end-effector of a serial manipulator (Fig. 8a). The external system is vertically positioned above the PMSM and enclosing tubular network, using field measurements from the sensor to track and follow the PMSM’s movement (Fig. 8b).
Fig. 8 [Images not available. See PDF.]
Magnetic localization and manipulation of the PMSM.
a External system combining a robot arm, a Hall effect magnetometer, and an electromagnet. b Experimental setup including a tubular network enclosing the PMSM, vertically suspended electromagnet and magnetometer, and an upward-facing camera. c Different operating modes for localization and manipulation, alternating between PMSM (un)locked states, combined with external magnet or magnetometer (in)activity. d Flow diagram for the localization and manipulation modes. e Navigation results.
The system alternates between localization and manipulation modes (Fig. 8c). In localization mode, the active PMSM generates a rotating field, while the Hall effect sensor takes temporal field measurements. In this mode, the electromagnet is off to prevent sensor saturation and interference with the motor. In manipulation mode, the PMSM is locked and behaves as a passive, radially magnetized permanent magnet. The electromagnet is on to generate a stationary field for PMSM steering, allowing mechanical rotation to change its deflection plane (Fig. 8d).
Quantitative results show successful entrance into all tube bifurcations, as well as forward and backward tracking over a total distance of 40 cm in 300 s (Fig. 8e and Supplementary Fig. 10). In localization mode, the PMSM operates at 1 Hz, and the sensor records data at 20 Hz over 2 s. Post-processing for pose reconstruction averaged 1 s, achieving a trajectory-following frequency of about 0.3 Hz.
Discussion
This study reports a magnetic localization method for in vivo rotatable dipoles, which herein is a new type of locking PMSM based on solid-liquid phase changing LMPA. The rotating field generated by the PMSM allows for the reconstruction of its position and rotation axis by and relative to a single magnetometer, with four possible solutions. Additionally, we integrated the magnetometer with an electromagnet to create an eye-in-hand sensorized mobile electromagnetic manipulation system. By demonstrating iterative PMSM localization and manipulation, we aimed to show the potential of closed mobile magnetic navigation systems to operate independently of fluoroscopic imaging.
PMSM design
The PMSM demonstrated that 2D fabricated flexible electronics may be used as 3D stators with combined functionality as sources of magnetic field and heat. Using the heat-generating property of stators has been used to achieve reversible rotor locking. The ferrofluid bearing minimized friction, opposed magnetic attraction between stators and rotor, and maintained concentricity during rotation (Supplementary Movie 1). However, manual fabrication (Fig. 2a) introduced functional inconsistencies. Alternatively, precise micro-fabricated parts should be considered for reliability and miniaturization50. Additionally, the application of excess ferrofluid encapsulated the rotor, preventing locking by the LMPA.
Rotor locking mechanism
The selection of Cerrolow 117 as the LMPA for reversible rotor locking was based on its 47 °C phase transition temperature, which is close to physiologically safe27 and below NdFeB demagnetization temperatures56. Also, atomically similar LMPAs have a viscosity close to water57 and a magnetic permeability close to air58. However, due to its liquid state and toxic elements, encapsulation is required for medical applications53.
Temperature measurements of the PMSM show that internal LMPA phase transition can be reached at surface temperatures (≤44 °C) that prevent tissue injury (Fig. 3c)27 Also, heating and cooling occur faster in water (37 °C) than in air (18 °C), with similar internal steady-state temperatures (49 °C). Surface temperature rises less in water (37–40 °C) than in air (18–31 °C). The system reaches steady-state in 20 s in water and 45 s in air, while passive cooling below the transition temperature takes just 2 s. This is indicative of the rate for switching between PMSM localization and manipulation modes. Therefore, mode-switching is limited by heating time.
Heating time during the rotor unlocking phase depends on power dissipation by the stators, which act as resistors. This process may be accelerated through a greater heat transfer rate, by increasing power dissipation with higher peak currents in the AC signal. However, for medical applications, temperature feedback would be required to maintain thermal biocompatibility59.
Localization algorithm
The presented algorithm localizes a PMSM, modeled as a magnetic dipole with perpendicular rotation and magnetization axes. At its core, the algorithm uses precomputed rotor field isoline functions (Eqs. 4–6) that link rotating field properties to the rotating field source (Supplementary Fig. 7). By computing a ratio (bratio) of maximum and minimum field strengths at a given position, the algorithm determines a set of isoline angles ({β, α}) to rotate the measured field’s rotation axis into four possible combinations of dipole position and rotation axis (Eqs. 8–10).
This fourfold ambiguity is also reported in previous work32. Herein, this is resolved using prior knowledge of dipole position. However, this method risks forwarding a previous faulty localization (Fig. 7). To prevent this, additional sensors may be mounted on the external manipulation system, enabling localization through triangulation.
Supporting the formulation of the isoline functions, we note that similar algorithms exist to localize a sensor based on the known temporal configuration of a rotating dipole32,60,61. However, in our reverse case, while similarly having access to field measurements, we have no information about the dipole rotation axis. This information is compensated for by formulating predetermined maps between rotating field components and the field source, i.e., the isoline functions.
Isoline function error sensitivity
The isoline functions exhibit different sensitivity to errors in field measurements depending on the relative configuration of the PMSM and sensor. Accordingly, regions of different localization error sensitivities may be distinguished around the rotor magnet33,62.
The error sensitivity describes how errors in the measured field ratio (Sbratio) affect errors in the isoline angles . Partial derivatives indicate that ∂β/∂bratio is least sensitive for bratio ∈ [1.1, 1.9], corresponding to β ∈ [25, 75]° (Supplementary Fig. 8). Further, ∣∂α/∂β∣ ≤ 1 ∀β ∈ [0, 60]°. This range corresponds to bratio ∈ [1.4, 2], for which errors in Sβ are mitigated in Sα but amplified above. Therefore, PMSM directionality vectors are least sensitive to reconstruction errors in Sbratio for relative rotor-sensor positions at β ∈ [25, 60]°, for which bratio ∈ [1.4, 1.9]. This region is supported by the localization experiments (Figs. 6 and 7).
Localization workspace
The localization workspace depends on the SNR of the rotor field measurement. The SNR is influenced by rotor size (magnetic moment) and sensor resolution, and noise. Here, the tri-axial Hall effect sensor has a 5 mT measurement range, ~3 μT peak noise (Supplementary Fig. 6), and 0.1 μT resolution. A minimum SNR of 10 dB was identified for localization (Fig. 6c). Accordingly, the workspace was limited to 40 mm distance from the sensor.
While this workspace is smaller than those using larger magnets32,38 or more precise sensors35,36, simulations suggest that reducing sensor noise could extend the workspace beyond 200 mm (Supplementary Fig. 11).
Localization accuracy
The localization accuracy, including angular errors in the PMSM’s directionality vectors of position and rotation axis , depends on angular errors in the (direction of) measured minimum field strength and rotation axis , as well as errors in the isoline angles ({Sβ, Sα}) (Eqs. 11–13). These are influenced by the sensor’s SNR, accuracy, and precision. In this work, angular errors of 5–10° in and 10–30° error in were observed for a cylindrical rotor magnet (1 mm diameter, 3 mm length) along various 3D trajectories (Fig. 7).
Alternative sources of error, such as micrometer-range eccentricity during rotor rotation (Supplementary Movie 1) is considered negligible due to its near-zero field gradient (Fig. 3f). The stator field is similarly considered negligible, as its strength is one to two orders weaker than the rotor field (Supplementary Fig. 6). To improve localization accuracy, we hypothesize including localization methods for stationary magnets31, as the rotor magnet’s field (after filtering Earth’s field) could be treated as stationary at each instant.
Localization frequency
The localization frequency (0.3 Hz) depends on the rate of rotor rotation (1 Hz), sensor sampling frequency (20 Hz), the number of samples (40), and computation time. Higher localization frequencies can be achieved using faster sampling or reducing the number of samples (speeding up measurement time and data processing). In combination, the rotor rotation rate could be increased, which was shown up to 10 Hz (Fig. 3i and Supplementary Movie 1). Faster rotor rotation rates may be achieved by increasing the current through the stators, at a cost of temperature elevation.
Magnetic manipulation
Magnetic manipulation was performed iteratively with localization, rather than simultaneously30,60. This was necessary due to saturation of the eye-in-hand Hall effect sensor upon activation of the electromagnet. Additionally, the manipulation field, typically up to a few tens of milli-Tesla9, is an order of magnitude stronger than the stator fields (Fig. 3b and Supplementary Fig. 6), which interfere with rotor rotation.
Rudimentary PMSM localization-informed system reconfiguration and manipulation were shown, limited to electromagnet displacement along the reconstructed motor rotation axis (Fig. 8c and Supplementary Movie 4). More advanced manipulation could be achieved by incorporating an electromagnet field model for model- and localization-informed reconfiguration16.
Finally, due to the unknown radial orientation of the PMSM magnetic moment, initial application of a manipulation field causes deflection in an indeterminate plane. As a solution, we hypothesize that for synchronous motors, frequency analysis and sinusoidal fitting of field measurements can provide a time-dependent function to predict the direction of magnetic moment and, therefore, plane of deflection.
Future work
The efficacy of PMSM localization can be increased by improving sensor noise, resolution, and count. Integrating the presented algorithm with those for stationary magnets may further improve accuracy. For dipoles rotating at a constant frequency, sinusoidal fitting could be used to estimate rotor orientation and predict PMSM deflection. Multiple PMSMs with distinct frequencies could be simultaneously located via frequency analysis. The localization method may be applied to any structure incorporating or representing a rotating magnetic dipole with perpendicular magnetization and rotation axes, such as intravascular imaging catheters50, swimming robots63, mechanically rotated continuum robots7, and magnetically actuated untethered robots64. Beyond localization, local PMSM-generated rotating fields could be used in vivo, such as for actuation of microrobots65,66, wireless power transfer to implants67, or aid in nerve regeneration68 and cancer therapy69,70.
Materials and methods
Fabrication of planar coils
Planar coils were fabricated from a 55 μm thick polyimide copper clad laminate (IM30-LM-000122, Goodfellow GmbH, Germany), comprising 25 μm thick polyimide, 12 μm epoxy adhesive, and 18 μm copper. The coils were prepared using optical lithography and wet etching processes. First, the copper surface was cleaned using O2 plasma for 2 min. Then, the AZ5214 photoresist (MicroChemicals GmbH, Germany) was spin-coated at 3000 rpm for 30 s and baked at 100 °C for 2 min. The coil structure was patterned using a direct UV-laser writer (DWL66, Heidelberg Instruments, Germany) with a 410 nm wavelength. The desired structure was revealed in 1:4 solution of AZ351b developer in deionized water. The laminate was subjected to post-baking at 100 °C for 2 min to ensure better adhesion of photoresist during wet etching. Thereafter, the laminate was wet etched at 60 °C in 1:10 sodium persulfate solution in DI water (B327, AG TermoPasty, Grzegorz Gasowski, Poland). Residual etching agent was removed with DI water, and the photoresist was cleaned off with acetone, isopropanol, and DI water.
Two versions of the planar coil were made (inner and outer) (Supplementary Fig. 1a). Each coil has 12 windings. (1) The inner coil has a length of 5.5 mm and a width of 4.35 mm. Copper strands have a width of 0.13 mm. Longitudinal strands are spaced 0.05 mm. Transverse strands are spaced 0.07 mm. The coil has a resistance of 0.9 Ω. (2) The outer coil has a length of 5.5 mm and a width of 4.8 mm. Copper strands have a width of 0.15 mm. Longitudinal strands are spaced 0.05 mm. Transverse strands are spaced 0.05 mm. The coil has a resistance of 0.82 Ω.
Assembly of the PMSM
Enameled copper leads with a 50 μm diameter (TRU Components, Conrad Electronic SE) are soldered to the terminals of the planar coils (Supplementary Fig. 1b). The coils are aligned and adhered with a 1.2 mm transverse offset using 50 μm thick double-sided tape (tesa® 61250) placed around the leads (Fig. 2a(i)), then inserted into a PVDF heat shrinkable tube (hellermanntyton 311-00169, Farnell) of 1.6 mm inner diameter, 1.9 mm outer diameter, and 7 mm length ((Fig. 2a(ii))). The coils’ center-to-center offset displacement provides perpendicular angular orientation between the wrapped coils.
The copper leads are threaded through a PTFE tube with a 0.66 mm inner and 0.96 mm outer diameter (ptfetubeshop, The Netherlands) (Fig. 2a(ii)), that serves as a protective tether and additionally houses a polyetheretherketone (PEEK) mandrel with 0.38 mm diameter (Zeus Industral Inc., USA). Heat is applied at 200 °C to shrink the PVDF tube, connecting it to the PTFE tether (Fig. 2a(iii)). Thereafter, low-friction resin (durable resin, Formlabs) is injected into the stator lumen, pushed down using a steel rod of 1.2 mm diameter, and UV-cured at 60 °C for 60 min (Form Cure, Formlabs), creating an airtight seal for the lumen and rigid connection to the PEEK mandrel.
A solid cylinder of fusible alloy (Cerrolow 117, Bolton Metal Products Co., Inc., USA) is placed in the rotor lumen (Fig. 2a(iv)). This cylinder is made by injecting liquefied alloy into a silicone tube of 1 mm inner diameter, followed by cooling and solidification, cutting to a 3 mm length with a Stanley knife, and subsequent removal of the cylinder from the tube. Then, a constant current of 150 mA is applied to the inner stator, resulting in heating and liquefying the alloy. Thereafter, a diametrically magnetized rotor of 1 mm diameter and 3 mm length (SP0103DM-50, First4Magnets, UK), partially coated with ferrofluidic bearing (M-FER-10, Supermagnete, The Netherlands), is inserted and submerged in the liquefied alloy (Fig. 2a(v)). Consequently, the alloy fills the space around the rotor and is pushed upwards toward the distal exit of the stator lumen (Fig. 2a(vi)). Upon deactivation of the stator, the alloy solidifies. Finally, the assembled motor is dip-coated in UV-curable resin (durable resin, Formlabs) and cured at 40 °C to prevent intermediate phase transition of the alloy during curing, as well as leakage during activation (Fig. 2a(vii)).
PMSM thermal characterization
Thermal characterization was performed in air (18 °C) and distilled water (37 °C), with the permament magnet synchronous motor (PMSM) having an empty rotor cavity, i.e., without an internal rotor magnet or fusible alloy (see Fig. 2b). Quadrature currents were applied to the inner and outer stator , with constant amplitude (I = 200 mA) and unit frequency (fm = 1 Hz).
Temperature measurements were obtained using a 1 mm diameter K-type thermocouple connected to a thermocouple-to-digital converter module (Diligent Pmod TC1, RS PRO, 134-6476) and an Arduino Nano during resistive heating (t ∈ [0, 120] s) and passive cooling (t ∈ [120, 180]). The thermocouple was positioned both on the outer surface of the PMSM and inside the rotor cavity to measure external and internal temperature increase, respectively (Supplementary Fig. 3).
Rotor field model
We present an analytical model for accurately describing the magnetic field generated by cylindrical radially magnetized permanent rotors. The rotor volume is discretized into subvolumes, each modeled as a field source using a multipole expansion model. Symmetry of the multipole expansion models among these subvolume field sources ensures axisymmetry of the magnetic field around the rotor’s magnetization axis. This model is herein referred to as an FE-inspired multipole/source expansion model.
Let be the rotor’s local reference frame at its center of mass. Here, is the longitudinal axis, the radial axes, and the magnetization axis. We also define a position vector (p ≔ Rp = 〈Rx, Ry, Rz〉) expressed in RR.
Given a base harmonic scalar potential (RΨ0(p = 1/∥p∥)) that satisfies Laplace’s equation, the corresponding field function (Rb0(p) = ∂(RΨ0)/∂p) is divergence- and curl-free as required by Maxwell’s equations in current-free space. This property extends to higher-order derivatives of the scalar potential with respect to the magnetization axis , and their associated fields (Rbu(p) = ∂(RΨu(p))/∂p), as well as those scaled by scalar coefficients . Scalar potentials with provide field functions Rbu(p) that contain (unpaired) monopole terms, such as tripole (u = 2) or pentapole (u = 4). The natural absence of monopoles therefore constrains to be uneven.
Scalar potentials are assigned to subvolumes of the rotor, with displacement vectors relative to RR. These vectors are part of a symmetric set with respect to the planes spanned by the principal axes in RR:where has positive/negative xyz-components, and is the ith ∈ {1, 2, . . . , 8} displacement vector. Symmetry of the field model around the magnetization axis requires coefficients for pole-specific scalar potentials to be equal for all displacement vectors in a symmetric set. Accordingly, the base harmonic scalar potential is formulated:
1
leading to the field expression for a symmetric set of source displacement vectors:2
Finally, the FE-inspired multipole/source expansion model is given by:3
This model was implemented using MATLAB’s symbolic toolbox (MATLAB R2024, The Mathworks, Natick, Massachusetts, USA). The model coefficients were obtained by linear least squares regression with field estimates obtained from a measurement-based scaled FEM of the rotor (COMSOL, Burlington, VT, USA), according to , where *† represents the pseudoinverse.
Rotor field isoline functions
Within the formulation of the following rotor field isoline functions, we again consider as the rotor’s local reference frame in its center of mass, and to span the rotor’s magnetization plane, as the rotor’s magnetization axis, and as the rotor’s rotation axis.
Isoline position
The isoline position vector function traces the circumference of two-dimensional, ellipse-shaped field isolines of uniform strength (biso) as a function of a position angle (β) relative to the rotor’s magnetization axis (see Fig. 4). This function is formulated as:
4
with cx(biso) and cz(biso) coefficients dependent on the isoline field strength, modeled as second-order power functions: , with cx,i(i ∈ {1, 2, 3}) the power function parameters. The same model applies to cz(biso).To calculate the power function parameters, the rotor field function Rb(p) is used to compute the magnetic field strength at various positions on a 2D grid within the magnetization plane. MATLAB’s contour function then generates matrices of 2D position vectors corresponding to different elliptical contour levels (biso). The ellipse coefficients (cx(biso), cz(biso)) for each contour level are then obtained using the fit_ellipse function71. Finally, the independent parameters of the power functions (cx,i, cz,i) are determined using MATLAB’s curve fitting toolbox.
Isoline field ratio
The isoline field ratio scalar function describes the ratio of maximum to minimum magnetic field strength at isoline position angles (β). This function is formulated as:
5
where ak, bk, and w are Fourier coefficients.To determine these coefficients, we select an isoline field strength (biso = 100 μT) and compute the field ratio over a range of position angles (β ∈ {1, 2, . . . , 360}°). The corresponding 2D isoline positions (pe(biso, β) = 〈pe,x, pe,z〉) are computed, and a 3D variant is defined as .
Using the 3D rotor field function (Rb(p)), maximum field and minimum field strength are calculated for each angle β, where Rz ∈ SO(3) is a rotation matrix corresponding to the rotor’s rotation axis . The field ratio is then determined as . Finally, the Fourier coefficients are obtained using MATLAB’s curve fitting toolbox, applying an 8-term Fourier series to fit bratio(β) across the range of β.
Isoline field angle
The isoline field angle scalar function decribes the angle between the isoline position vector and the field rotation axis. This function is formulated as:
6
where ak, fk, and bk are Fourier parameters.To determine these parameters, we again select an isoline field strength (biso = 100 μT) and range of position angles (β ∈ {1, 2, . . . , 360}°), and compute 2D isoline positions (pe(biso, β) = 〈pe,x, pe,z〉), a 3D variant , and maximum field strength and minimum field strength . The field rotation axis at each β is then computed as , where denotes a unit vector. The isoline field angle is then obtained as . Finally, the Fourier parameters, including amplitudes (ak), frequencies (fk), and phases (bk), are obtained with the ft_spect function72.
Motor field properties
A PMSM driven by quadrature currents in the inner and outer stators at a given motor frequency (fm) generates a rotating magnetic field (Sbm(t)). Field measurements are taken with a Hall effect sensor (MLX90371, Melexis, Ypres, Belgium) positioned around the PMSM, at a sampling frequency, fs = 20 Hz. The sensor samples the tri-axial magnetic field (Sb(t) = Sb0 + Sbm(t) + ns(t)), which includes Earth’s static field (Sb0), the motor field Sbm(t), and sensor noise (ns(t)).
Tri-axial field measurements recorded at discrete time instants (iΔt), where Δt = 1/fs, are stored in matrix form (SB = [Sb(t0), Sb(t1), …, Sb(tM)]). Fourier-derived frequency-specific amplitudes (Afft(f )) are obtained with MATLAB’s fft function, giving the Earth’s field as Sb0 = Afft(0). The motor field measurements matrix (SBm = [Sbm(t0), Sbm(t1), …, Sbm(tM)]) is then computed, with Sbm(ti) = Sb(ti)−Sb0.
Considering zero noise, Sbm(t) forms an ellipse and rotates in a plane with a normal vector equal to the field’s rotation axis , computed using the following minimization problem implemented with MATLAB’s fmincon:
7
where denotes a unit vector. Further, we fit a 3D ellipse to SBm, whose principal axes correspond to the vectors of maximum and minimum field strength. To this end, we define a rotation matrix between the sensor and field ellipse frame where , and is arbitrary. The motor field measurements are projected onto the 2D ellipse plane as . A 2D ellipse is then fit to the xy-components (EBm,xy) using the fit_ellipse function implemented in MATLAB71. Given sufficient data points, it is assumed that sensor noise (ns(t)) is averaged out during the fitting of the ellipse. The principal axes of this ellipse represent the vectors of maximum (Ebmax,xy) and minimum (Ebmin,xy) field strength. Their respective 3D representations (Eb = 〈Ebxy, 0〉) are then transformed back to the sensor’s reference frame, yielding and . Finally, the field ratio is obtained as . Given the theoretical limits of field ratio (bratio(β) ∈ [1, 2]), any measured Sbratio that falls outside this range is adjusted to the nearest boundary value.Reconstruction of motor pose
The motor pose relative to and expressed in the sensor frame {S} is defined by the motor’s position (Spm) and rotation axis (Sωm). These vectors are computed using the measured motor field properties and rotor field isoline functions, including isoline position (pe(biso, β)), field ratio (bratio(β)), and field angle (α(β)).
An isoline position in the rotor’s magnetization plane is matched to the sensor’s motor field measurements according to:
8
9
10
where is the measured isoline field strength. Because the vectors and span the reconstructed magnetization plane, with being perpendicular to this plane, a rotation matrix is defined based on the rotation vector , and the motor pose is computed as:11
12
13
where cj ∈ {−1, 1}(j ∈ {1, 2}) are coefficients that represent rotation direction. Herein, the coefficients are determined based on a previously known or reconstructed motor position vector according to:14
In the herein presented demonstrations of magnetic localization and manipulation, the initial motor position vector was provided to the localization algorithm.Magnetic localization and manipulation
The magnetic localization and manipulation hardware includes an external integrated Hall effect sensor (MLX90371, Melexis, Belgium), a custom electromagnetic coil, and a robotic arm (Kuka LBR IIwa-14 R821, Augsburg, Germany), as well as an internal PMSM. The PMSM navigates a custom tubular network of opaque silicone tubes and Y-shaped connectors, each with a 6 mm inner diameter, demonstrating 2D localization and manipulation thereof in the horizontal xy-plane.
For localization, the external system provides the sensor’s temporal orientation and position relative to base of the robot. When the PMSM is active and near the sensor, the pose reconstruction using the measured motor field matrix (SBm) leads to the motor position (Spm) and rotation axis relative to both the sensor and robot base, calculated as and . The robot then repositions the sensor horizontally above the calculated motor position.
For manipulation, when the PMSM is inactive, the electromagnet is displaced 20 mm along the xy-projection of the last reconstructed . The electromagnet generates a static magnetic field across the PMSM, which is manually rotated to alter its magnetization direction and deflection plane. The electromagnet is then turned off and reset to its initial position.
Motor power system
The motor power system comprises a custom-designed coil driver connected to the stator leads of the PMSM (Supplementary Fig. 12). The coil driver includes a bidirectional DC triple motor controller shield (Motoron M3S256, Pololu Robotics) connected to an Arduino UNO. Each output of the shield is connected in series to a custom inductor (~50 μH), made of a 6 mm diameter ferrite core (RSPro, Fair-Rite, 172-9993) and manually wound 0.5 mm diameter copper wire, and a current sensor (ACS712 5A, AZDelivery).
The output signal of the current sensor is smoothened by a 10 nF ceramic capacitor placed between its ground and output pins. This current sensor is used in closed-loop current regulation, managed by a custom-designed PID controller. The Arduino board is powered via a PC with a serial communication to command the current amplitudes and frequencies for stator activation. Finally, the motor shield is powered through a socket connected to a 240 V AC to 24 V DC transformer, which is then stepped down to 8 V using a DC-DC converter (LM2596S, AZDelivery).
Acknowledgements
This work was supported by the European Research Council (ERC) under the European Union’s Horizon 2020 Research and Innovation Programme under grant 866494 Project–MAESTRO. Also, this work was financially supported in part by German Research Foundation (DFG) grant MA 5144/33-1, the European Union in the frame of project REGO (ID: 101070066), and ERC grant 3DmultiFerro (Project number: 101141331).
Author contributions
M.R. conceived and managed the project. M.R. and L.M. fabricated the synchronous motors. M.R. developed the field model and localization algorithm, and conducted the characterization and tracking experiments. P.M. and D.M. designed and fabricated the planar electromagnetic coils. All authors contributed to discussions and interpretation of results. M.R. wrote the manuscript with input from all authors. V.K.V. and D.M. supervised aspects of the research and experimental work. S.M., as principal investigator, provided overall project supervision and strategic guidance.
Peer review
Peer review information
Communications Engineering thanks Heng Wang and the other, anonymous, reviewers for their contribution to the peer review of this work. Primary Handling Editors: [Miranda Vinay and Rosamund Daw]. Peer reviewer reports are available.
Data availability
The authors declare that data supporting the findings of this study are available within the paper and its Supplementary Information files.
Code availability
All the relevant code used to generate the results in this paper and supplementary information are available from the corresponding author upon reasonable request.
Competing interests
The authors declare no competing interests.
Supplementary information
The online version contains supplementary material available at https://doi.org/10.1038/s44172-025-00424-3.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
1. Kim, Y; Zhao, X. Magnetic soft materials and robots. Chem. Rev.; 2022; 122, pp. 5317-5364. [DOI: https://dx.doi.org/10.1021/acs.chemrev.1c00481]
2. Yang, Z., Yang, H., Cao, Y., Cui, Y. & Zhang, L. Magnetically actuated continuum medical robots: a review. Adv. Intell. Syst. 5, 2200416 (2023).
3. Du, X; Yu, J. Image-integrated magnetic actuation systems for localization and remote actuation of medical miniature robots: a survey. IEEE Trans. Robot.; 2023; 39, pp. 2549-2568. [DOI: https://dx.doi.org/10.1109/TRO.2023.3271582]
4. Kim, Y et al. Telerobotic neurovascular interventions with magnetic manipulation. Sci. Robot.; 2022; 7, eabg9907. [DOI: https://dx.doi.org/10.1126/scirobotics.abg9907]
5. Pittiglio, G et al. Patient-specific magnetic catheters for atraumatic autonomous endoscopy. Soft Robot.; 2022; 9, pp. 1120-1133. [DOI: https://dx.doi.org/10.1089/soro.2021.0090]
6. Richter, M et al. Magnetic soft helical manipulators with local dipole interactions for flexibility and forces. Soft Robot.; 2023; 10, pp. 647-659. [DOI: https://dx.doi.org/10.1089/soro.2022.0031]
7. Dreyfus, R et al. Dexterous helical magnetic robot for improved endovascular access. Sci. Robot.; 2024; 9, eadh0298. [DOI: https://dx.doi.org/10.1126/scirobotics.adh0298]
8. Yang, Z; Zhang, L. Magnetic actuation systems for miniature robots: a review. Adv. Intell. Syst.; 2020; 2, 2000082. [DOI: https://dx.doi.org/10.1002/aisy.202000082]
9. Kladko, DV; Vinogradov, VV. Magnetosurgery: principles, design, and applications. Smart. Mater. Med.; 2024; 5, pp. 24-35. [DOI: https://dx.doi.org/10.1016/j.smaim.2023.06.008]
10. Nelson, B. J. An electromagnetic robot for navigating medical devices. Nat. Rev. Bioeng. 2, 370–371 (2024).
11. Gervasoni, S et al. A human-scale clinically ready electromagnetic navigation system for magnetically responsive biomaterials and medical devices. Adv. Mater.; 2024; 36, 2310701. [DOI: https://dx.doi.org/10.1002/adma.202310701]
12. Richter, M; Venkiteswaran, VK; de Vries, J-P; Misra, S. Apollo: advanced magnetic probes for minimally invasive endovascular interventions. Eur. Heart J.; 2024; 45, pp. 2589-2591. [DOI: https://dx.doi.org/10.1093/eurheartj/ehae155]
13. Obstein, K et al. The magnetic flexible endoscope: Phase 1 first-in-human trial. Gastrointest. Endosc.; 2024; 99, AB581. [DOI: https://dx.doi.org/10.1016/j.gie.2024.04.2659]
14. Edelmann, J; Petruska, AJ; Nelson, BJ. Magnetic control of continuum devices. Int. J. Rob. Res.; 2017; 36, pp. 68-85. [DOI: https://dx.doi.org/10.1177/0278364916683443]
15. Lussi, J et al. Magnetically guided laser surgery for the treatment of twin-to-twin transfusion syndrome. Adv. Intell. Syst.; 2022; 4, 2200182. [DOI: https://dx.doi.org/10.1002/aisy.202200182]
16. Sikorski, J; Denasi, A; Bucchi, G; Scheggi, S; Misra, S. Vision-based 3-D control of magnetically actuated catheter using bigmag—an array of mobile electromagnetic coils. IEEE ASME Trans. Mechatron.; 2019; 24, pp. 505-516. [DOI: https://dx.doi.org/10.1109/TMECH.2019.2893166]
17. Laulicht, B; Gidmark, NJ; Tripathi, A; Mathiowitz, E. Localization of magnetic pills. Proc. Natl. Acad. Sci. USA; 2011; 108, pp. 2252-2257. [DOI: https://dx.doi.org/10.1073/pnas.1016367108]
18. Hwang, J et al. An electromagnetically controllable microrobotic interventional system for targeted, real-time cardiovascular intervention. Adv. Healthc. Mater.; 2022; 11, 2102529. [DOI: https://dx.doi.org/10.1002/adhm.202102529]
19. Hong, A; Petruska, AJ; Zemmar, A; Nelson, BJ. Magnetic control of a flexible needle in neurosurgery. IEEE Trans. Biomed. Eng.; 2020; 68, pp. 616-627. [DOI: https://dx.doi.org/10.1109/TBME.2020.3009693]
20. Dreyfus, R., Boehler, Q., Chautems, C. & Nelson, B. A navigation console to steer magnetic instruments under radiological guidance for neuro-vascular interventions. In Proc. 14th Hamlyn Symposium on Medical Robotics 2022 79–80 (The Hamlyn Centre, Imperial College London, 2022).
21. Tognarelli, S et al. Magnetic propulsion and ultrasound tracking of endovascular devices. J. Robot. Surg.; 2012; 6, pp. 5-12. [DOI: https://dx.doi.org/10.1007/s11701-011-0332-1]
22. Heunis, CM; Wotte, YP; Sikorski, J; Furtado, GP; Misra, S. The armm system-autonomous steering of magnetically-actuated catheters: towards endovascular applications. IEEE Robot. Autom. Lett.; 2020; 5, pp. 705-712. [DOI: https://dx.doi.org/10.1109/LRA.2020.2965077]
23. Suligoj, F; Heunis, CM; Sikorski, J; Misra, S. Robust–an autonomous robotic ultrasound system for medical imaging. IEEE Access; 2021; 9, pp. 67456-67465. [DOI: https://dx.doi.org/10.1109/ACCESS.2021.3077037]
24. Li, Z. et al. Design and hierarchical control of a homocentric variable stiffness magnetic catheter for multi-arm robotic ultrasound-assisted coronary intervention. IEEE Trans. Robot. 40, 2306–2326 (2024).
25. Erin, O; Boyvat, M; Tiryaki, ME; Phelan, M; Sitti, M. Magnetic resonance imaging system-driven medical robotics. Adv. Intell. Syst.; 2020; 2, 1900110. [DOI: https://dx.doi.org/10.1002/aisy.201900110]
26. Mutlu, S; Yasa, O; Erin, O; Sitti, M. Magnetic resonance imaging-compatible optically powered miniature wireless modular Lorentz force actuators. Adv. Sci.; 2021; 8, 2002948. [DOI: https://dx.doi.org/10.1002/advs.202002948]
27. Phelan III, MF; Tiryaki, ME; Lazovic, J; Gilbert, H; Sitti, M. Heat-mitigated design and Lorentz force-based steering of an MRI-driven microcatheter toward minimally invasive surgery. Adv. Sci.; 2022; 9, 2105352. [DOI: https://dx.doi.org/10.1002/advs.202105352]
28. Aziz, A et al. Medical imaging of microrobots: toward in vivo applications. ACS Nano; 2020; 14, pp. 10865-10893. [DOI: https://dx.doi.org/10.1021/acsnano.0c05530]
29. Carpi, F; Pappone, C. Stereotaxis niobe® magnetic navigation system for endocardial catheter ablation and gastrointestinal capsule endoscopy. Expert Rev. Med. Devices; 2009; 6, pp. 487-498. [DOI: https://dx.doi.org/10.1586/erd.09.32]
30. von Arx, D et al. Simultaneous localization and actuation using electromagnetic navigation systems. IEEE Trans. Robot.; 2023; 40, pp. 1292-1308. [DOI: https://dx.doi.org/10.1109/TRO.2023.3340324]
31. Son, D; Yim, S; Sitti, M. A 5-D localization method for a magnetically manipulated untethered robot using a 2-D array of hall-effect sensors. IEEE ASME Trans. Mechatron.; 2015; 21, pp. 708-716. [DOI: https://dx.doi.org/10.1109/TMECH.2015.2488361]
32. Popek, K. M., Mahoney, A. W. & Abbott, J. J. Localization method for a magnetic capsule endoscope propelled by a rotating magnetic dipole field. In Proc.2013 IEEE International Conference on Robotics and Automation 5348–5353 (IEEE, 2013).
33. Taddese, AZ et al. Enhanced real-time pose estimation for closed-loop robotic manipulation of magnetically actuated capsule endoscopes. Int. J. Rob. Res.; 2018; 37, pp. 890-911. [DOI: https://dx.doi.org/10.1177/0278364918779132]
34. Rivkin, B et al. Electronically integrated microcatheters based on self-assembling polymer films. Sci. Adv.; 2021; 7, eabl5408. [DOI: https://dx.doi.org/10.1126/sciadv.abl5408]
35. Gleich, B; Schmale, I; Nielsen, T; Rahmer, J. Miniature magneto-mechanical resonators for wireless tracking and sensing. Science; 2023; 380, pp. 966-971. [DOI: https://dx.doi.org/10.1126/science.adf5451]
36. Fischer, F; Gletter, C; Jeong, M; Qiu, T. Magneto-oscillatory localization for small-scale robots. NPJ Robot.; 2024; 2, 1. [DOI: https://dx.doi.org/10.1038/s44182-024-00008-x]
37. Yim, S; Sitti, M. 3-D localization method for a magnetically actuated soft capsule endoscope and its applications. IEEE Trans. Robot.; 2013; 29, pp. 1139-1151. [DOI: https://dx.doi.org/10.1109/TRO.2013.2266754]
38. Popek, KM; Schmid, T; Abbott, JJ. Six-degree-of-freedom localization of an untethered magnetic capsule using a single rotating magnetic dipole. IEEE Robot. Autom. Lett.; 2016; 2, pp. 305-312. [DOI: https://dx.doi.org/10.1109/LRA.2016.2608421]
39. Norton, JC et al. Intelligent magnetic manipulation for gastrointestinal ultrasound. Sci. Robot.; 2019; 4, eaav7725. [DOI: https://dx.doi.org/10.1126/scirobotics.aav7725]
40. Sharma, S et al. Wireless 3D surgical navigation and tracking system with 100μm accuracy using magnetic-field gradient-based localization. IEEE Trans. Med. Imaging; 2021; 40, pp. 2066-2079. [DOI: https://dx.doi.org/10.1109/TMI.2021.3071120]
41. Xu, Y; Li, K; Zhao, Z; Meng, MQ-H. A novel system for closed-loop simultaneous magnetic actuation and localization of WCE based on external sensors and rotating actuation. IEEE Trans. Autom. Sci. Eng; 2020; 18, pp. 1640-1652. [DOI: https://dx.doi.org/10.1109/TASE.2020.3013954]
42. Xu, Y; Li, K; Zhao, Z; Meng, MQ-H. Adaptive simultaneous magnetic actuation and localization for WCE in a tubular environment. IEEE Trans. Robot.; 2022; 38, pp. 2812-2826. [DOI: https://dx.doi.org/10.1109/TRO.2022.3161766]
43. Zhang, M., Yang, L., Zhang, C., Yang, Z. & Zhang, L. Simultaneous actuation and localization of magnetic robots using mobile coils and eye-in-hand hall-effect sensors. In Proc.2021 IEEE/RSJ International Conference on Intelligent Robots and Systems 8515–8521 (IEEE, 2021).
44. Paperno, E; Sasada, I; Leonovich, E. A new method for magnetic position and orientation tracking. IEEE Trans. Magn.; 2001; 37, pp. 1938-1940. [DOI: https://dx.doi.org/10.1109/20.951014]
45. Makarov, D., Melzer, M., Karnaushenko, D. & Schmidt, O. G. Shapeable magnetoelectronics. Appl. Phys. Lett. 3, 011101 (2016).
46. Assadsangabi, B., Tee, M. & Takahata, K. Ferrofluid-assisted levitation mechanism for micromotor applications. In Proc.2013 Transducers & Eurosensors XXVII: The 17th International Conference on Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS & EUROSENSORS XXVII) 2720–2723 (IEEE, 2013).
47. Assadsangabi, B; Tee, MH; Wu, S; Takahata, K. Catheter-based microrotary motor enabled by ferrofluid for microendoscope applications. J. Microelectromech. Syst.; 2016; 25, pp. 542-548. [DOI: https://dx.doi.org/10.1109/JMEMS.2016.2551222]
48. Jayhooni, SMH; Assadsangabi, B; Takahata, K. A stepping micromotor based on ferrofluid bearing for side-viewing microendoscope applications. Sens. Actuator A Phys.; 2018; 269, pp. 258-268. [DOI: https://dx.doi.org/10.1016/j.sna.2017.11.020]
49. Bandorf, R et al. Different carbon based thin films and their microtribological behaviour in MEMS applications. Surf. Coat. Technol.; 2005; 200, pp. 1777-1782. [DOI: https://dx.doi.org/10.1016/j.surfcoat.2005.08.104]
50. Wang, T et al. Development of a high-speed synchronous micro motor and its application in intravascular imaging. Sens. Actuator A Phys.; 2014; 218, pp. 60-68. [DOI: https://dx.doi.org/10.1016/j.sna.2014.07.020]
51. Ghalichechian, N; Modafe, A; Beyaz, MI; Ghodssi, R. Design, fabrication, and characterization of a rotary micromotor supported on microball bearings. J. Microelectromech. Syst.; 2008; 17, pp. 632-642. [DOI: https://dx.doi.org/10.1109/JMEMS.2008.916346]
52. Chautems, C. & Nelson, B. J. The tethered magnet: force and 5-DOF pose control for cardiac ablation. In Proc.IEEE International Conference on Robotics and Automation. 4837–4842 (IEEE, 2017).
53. Chautems, C et al. Magnetic continuum device with variable stiffness for minimally invasive surgery. Adv. Intell. Syst.; 2020; 2, 1900086. [DOI: https://dx.doi.org/10.1002/aisy.201900086]
54. Richter, M. et al. Locally addressable energy efficient actuation of magnetic soft actuator array systems. Adv. Sci. 10, e2302077 (2023).
55. Petruska, AJ; Abbott, JJ. Optimal permanent-magnet geometries for dipole field approximation. IEEE Trans. Magn.; 2012; 49, pp. 811-819. [DOI: https://dx.doi.org/10.1109/TMAG.2012.2205014]
56. Calin, M.-D. & Helerea, E. Temperature influence on magnetic characteristics of NdFeB permanent magnets. In Proc. 2011 7th International Symposium on Advanced Topics in Electrical Engineering 1–6 (IEEE, 2011).
57. Kuhn, H; Hughes, W; Gaylord, E. Measurements of the viscosity of liquid wood’s metal. Br. J. Appl. Phys.; 1962; 13, 527. [DOI: https://dx.doi.org/10.1088/0508-3443/13/10/122]
58. Zhang, X; Liu, J; Deng, Z. Bismuth-based liquid metals: advances, applications, and prospects. Mater. Horiz.; 2024; 11, pp. 1369-1394. [DOI: https://dx.doi.org/10.1039/D3MH01722B]
59. Mattmann, M et al. Thermoset shape memory polymer variable stiffness 4D robotic catheters. Adv. Sci.; 2022; 9, 2103277. [DOI: https://dx.doi.org/10.1002/advs.202103277]
60. Popek, K. M., Hermans, T. & Abbott, J. J. First demonstration of simultaneous localization and propulsion of a magnetic capsule in a lumen using a single rotating magnet. In Proc. 2017 IEEE International Conference on Robotics and Automation 1154–1160 (IEEE, 2017).
61. Sperry, AJ; Christensen, JJ; Abbott, JJ. Six-degree-of-freedom localization with a 3-axis accelerometer and a 2-axis magnetometer for magnetic capsule endoscopy. IEEE Robot. Autom. Lett.; 2022; 7, pp. 2110-2115. [DOI: https://dx.doi.org/10.1109/LRA.2022.3143293]
62. Shen, Y., Dong, S., Liu, D., Zhang, K. & Wang, H. Active 6-DOF electromagnetic pose tracking using orientation control of the magnetic source. In Proc.IEEE ROBIO 1–7 (IEEE, 2023).
63. Valdastri, P et al. A novel magnetic actuation system for miniature swimming robots. IEEE Trans. Robot.; 2011; 27, pp. 769-779. [DOI: https://dx.doi.org/10.1109/TRO.2011.2132910]
64. Ligtenberg, L-JW et al. Ex vivo validation of magnetically actuated intravascular untethered robots in a clinical setting. Comms. Eng.; 2024; 3, 68. [DOI: https://dx.doi.org/10.1038/s44172-024-00215-2]
65. Hou, Y et al. A review on microrobots driven by optical and magnetic fields. Lab Chip; 2023; 23, pp. 848-868. [DOI: https://dx.doi.org/10.1039/D2LC00573E]
66. Ebrahimi, N et al. Magnetic actuation methods in bio/soft robotics. Adv. Funct. Mater.; 2021; 31, 2005137. [DOI: https://dx.doi.org/10.1002/adfm.202005137]
67. Khan, SR; Pavuluri, SK; Cummins, G; Desmulliez, MP. Wireless power transfer techniques for implantable medical devices: a review. Sensors; 2020; 20, 3487. [DOI: https://dx.doi.org/10.3390/s20123487]
68. Qian, Y et al. Advances in electrical and magnetic stimulation on nerve regeneration. Regen. Med.; 2019; 14, pp. 969-979. [DOI: https://dx.doi.org/10.2217/rme-2018-0079]
69. Zhang, E et al. Dynamic magnetic fields remote-control apoptosis via nanoparticle rotation. ACS Nano; 2014; 8, pp. 3192-3201. [DOI: https://dx.doi.org/10.1021/nn406302j]
70. Choi, J et al. Magnetically enhanced intracellular uptake of superparamagnetic iron oxide nanoparticles for antitumor therapy. ACS Nano; 2023; 17, pp. 15857-15870. [DOI: https://dx.doi.org/10.1021/acsnano.3c03780]
71. Aghayan, A. fit_ellipse. https://www.mathworks.com/matlabcentral/fileexchange/3215-fit_ellipse, MATLAB Central File Exchange, Retrieved June 20, 2024 (2003).
72. Aghayan, A. Amplitude and phase spectra of a signal (Fourier transform). https://www.mathworks.com/matlabcentral/fileexchange/63965-amplitude-and-phase-spectra-of-a-signal-fourier-transform, MATLAB Central File Exchange, Retrieved May 16, 2024 (2020).
Copyright Springer Nature B.V. Dec 2025