Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Jan;23(1):79-87.
doi: 10.1038/s41563-023-01698-8. Epub 2023 Nov 13.

Task-adaptive physical reservoir computing

Affiliations

Task-adaptive physical reservoir computing

Oscar Lee et al. Nat Mater. 2024 Jan.

Abstract

Reservoir computing is a neuromorphic architecture that may offer viable solutions to the growing energy costs of machine learning. In software-based machine learning, computing performance can be readily reconfigured to suit different computational tasks by tuning hyperparameters. This critical functionality is missing in 'physical' reservoir computing schemes that exploit nonlinear and history-dependent responses of physical systems for data processing. Here we overcome this issue with a 'task-adaptive' approach to physical reservoir computing. By leveraging a thermodynamical phase space to reconfigure key reservoir properties, we optimize computational performance across a diverse task set. We use the spin-wave spectra of the chiral magnet Cu2OSeO3 that hosts skyrmion, conical and helical magnetic phases, providing on-demand access to different computational reservoir responses. The task-adaptive approach is applicable to a wide variety of physical systems, which we show in other chiral magnets via above (and near) room-temperature demonstrations in Co8.5Zn8.5Mn3 (and FeGe).

PubMed Disclaimer

Conflict of interest statement

The authors declare no competing interests.

Figures

Fig. 1
Fig. 1. Working principles of physical reservoir computing with a chiral magnet.
a, Illustration of a task-adaptive reservoir computing framework. Different magnetic phases are accessed by controlling the external magnetic field (H) and temperature (T). The rightmost panel shows the experimental schematic of the VNA-assisted spin-wave spectroscopy setup. VNA, vector network analyser. b, Typical input scheme for forecasting (left: Mackey–Glass signal) and transformation (right: sine wave) tasks. The original input signal, u(t), is mapped to u'(N), which is defined by the mapped field-cycling protocol (see main text and Methods for details). Note that Hrange defines the full range of applied fields, where the distance between Hlow and Hhigh at any given N, is the width of cycling, Hrange/2. A single field cycle is highlighted by the orange box in the transformation panel. c, S11 (denoted as ΔS11 after pre-processing; see Methods) as a function of the frequency f after accumulating N field cycles and visualization of R(N, M); a collective spectral evolution for N field cycles for skyrmion and conical phases, separated into ‘training’ and ‘test’ datasets. d, Results after applying Wout on the unseen ‘test’ dataset. Left: forecasting of a differential chaotic time-series data, Mackey–Glass signal by 10 future steps. Right: transformation of a sine wave to a square-wave signal. In both cases, reservoir prediction (transformation) results are plotted in blue (purple), the red dotted line depicts the target signal and the grey line represents the control prediction where ridge regression is performed on the raw input data without the physical reservoir. MSEFC and MSETR quantify the computation performance of forecasting and transformation, respectively.
Fig. 2
Fig. 2. Field-cycling-dependent spin-wave spectra as a physical reservoir.
a, Schematic of the temperature phase diagram for the bulk crystal Cu2OSeO3. The yellow dashed vertical (horizontal) line indicates the experimental conditions for our cycling experiments shown in c (d). b, The cycling number dependence of the spin-wave spectra in Cu2OSeO3 for Hc = 60 mT and 4 K. The evolution of the skyrmion-phase spectrum is shown for increasing values of N. Grey lines are added as a guide to the eye to keep track of the skyrmion modes. c, Hc dependence of the spin-wave spectra in Cu2OSeO3 for 4 K after 920 field cycles. d, Temperature dependence of the spin-wave spectra for Hc = 60 mT after 920 field cycles. e, Microwave absorption spectra as a function of f and N for different values of Hc at T = 4 K (upper row) and 35 K (lower row). The input signal in all plots is a sine wave with Hrange = 90 mT.
Fig. 3
Fig. 3. Reservoir computing performance of different magnetic phase spaces.
MSE performance comparison of different computation tasks across three distinct physical phases (skyrmion, skyrmion–conical hybrid and conical) at T = 4 K. In ac, the red dotted and grey curves represent the target functions and the computation results without the physical reservoirs, respectively. Blue, orange and purple curves display calculations with the physical reservoirs of skyrmion, skyrmion–conical hybrid and conical phases, respectively. a, Forecasting a Mackey–Glass chaotic time series of ten steps ahead (MG(N + 10)). b, Nonlinear transformation of a sine-wave input into saw waveforms. c, Combined transform/forecasting of ten future steps of a cubed Mackey–Glass signal. d, Illustration of the mapped field-cycling protocol visualized as a modified boxplot (details in the main text). e,g, Evaluation of MSE values at a constant Hrange as a variation of Hc and T, respectively, for forecasting (MG(N + 10)) (e) and transformation (square wave) (g) target applications. f, Evaluation of MSE values at a constant Hc as a variation of Hrange and T for a transformation (square wave) target application. The colour scale in g also applies to f.
Fig. 4
Fig. 4. Computation properties associated with physical characteristics.
ac, Spin-wave spectra of the helical (a), skyrmion (b) and conical (c) magnetic phases. d, Sine-wave input sequence defining the applied field amplitudes. eg, Spin-wave spectra of the helical (e), skyrmion (f) and conical (g) phases at nodes of the sine-wave input fields from d. h, Hc evolution of the MSE values at T = 4 K and Hrange = 90 mT, for forecasting (MG(N + 10)) and transformation (square wave) target applications. Note that MSE' denotes the normalized scale of MSE for [0, 1], where 0 (1) represents the best (worst) MSE. A (meta)stable magnetic field range for each phase is colour-coded. i, MSE' and task-agnostic metric results as a function of Hc at T = 4 K. j, Correlation matrix of Spearman’s rank correlation coefficient. k, Performance of forecasting as an evolution of the MC metric. l, Performance of transformation as an evolution of the CP metric.
Fig. 5
Fig. 5. Above-room-temperature demonstration of task adaptability using Co8.5Zn8.5Mn3.
a, Two-dimensional plot of the real part of the a.c. susceptibility (χ′) to identify magnetic phases in a Co8.5Zn8.5Mn3 crystal with helical, skyrmion, conical and ferromagnetic phases. The vertical dotted line represents the temperature at which we performed the reservoir computing experiments. b,c, Spin dynamics spectra measured during field cycling N showing the reservoir computing performance for forecasting (b) and transformation (c) at 333 K, at different centre fields of 15 mT (left spectra) and 60 mT (right spectra). dg, Reservoir computing performance of predicting the nonlinear Mackey–Glass function for five future steps (d,f) and transformation from a sine input signal to triangle output function (e,g). The red dotted curves denote the target function and the blue and purple solid curves are calculations generated via our reservoir computing.

References

    1. Marković D, Mizrahi A, Querlioz D, Grollier J. Physics for neuromorphic computing. Nat. Rev. Phys. 2020;2:499–510.
    1. Schuman CD, et al. Opportunities for neuromorphic computing algorithms and applications. Nat. Comput. Sci. 2022;2:10–19. - PubMed
    1. Jaeger, H. The “Echo State” Approach to Analysing and Training Recurrent Neural Networks – With an Erratum Note (GMD-Forschungszentrum Informationstechnik, 2010).
    1. Maass W, Natschläger T, Markram H. Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 2002;14:2531–2560. - PubMed
    1. Nakajima, K. & Fischer, I. (eds) Reservoir Computing: Theory, Physical Implementations, and Applications (Springer, 2021).