This is an outdated version published on 2022-12-27 00:38:44 UTC. Read the most recent version.
Preprint / Version 2

Dynamic Mode Decomposition with Memory

##article.authors##

  • Ryoji Anzaki AI Development Department, System Development Center, Tokyo Electron Ltd. https://orcid.org/0000-0002-6395-8799
  • Kei Sano AI Development Department, System Development Center, Tokyo Electron Ltd.
  • Takuro Tsutsui AI Development Department, System Development Center, Tokyo Electron Ltd. https://orcid.org/0000-0001-9683-3952
  • Masato Kazui AI Development Department, System Development Center, Tokyo Electron Ltd.
  • Takahito Matsuzawa AI Development Department, System Development Center, Tokyo Electron Ltd. https://orcid.org/0000-0001-5430-1501

DOI:

https://doi.org/10.51094/jxiv.176

Keywords:

dynamic mode decomposition, fractional-order derivative, time-series data

Abstract

In many realms of science and engineering, the time-evolution of a system plays a key role in analyzing, controlling and predicting the behavior of the system. Ranging from the climate data collected by the observation satellites to the classical mechanical motion of manufacturing equipment, there are vast amount of accumulated time-series data in ready-to-use formats.

One established and still developing method for time-series data analysis is the dynamic mode decomposition (DMD), a linear operation-based, model-free method proposed in 2008 by Schmid et al. The DMD, especially in the context of the Koopman theory, assumes the time-evolution model in which the variables evolve in time according to a homogeneous, constant-coefficient first-order ordinary differential equation (ODE). Although the DMD proves itself as one of the successful methods for time-series data analysis in its relatively short history, the abovementioned limitations on the time-evolution model still restricts the DMD from application to wider range of phenomena. Among such phenomena, we pay attention to the memory effects in time-series data. A system is said to have memory if its time-evolution is determined by the past states of the system. The DMD is based on the ODEs and thus cannot incorporate the memory effects.

In this paper, we present a novel method, DMD with memory (DMDm), to overcome the memoryless restriction on the time-evolution model in the existing DMD methods. We introduce a class of initial value problems whose solutions correspond to the eigenmode of a linear operation. Using such a linear transformation in time domain, instead of the time-difference operator, we enlarge the DMD into a wider class of time-evolution models.

As a solid example of this idea, we utilize the Caputo fractional differential to extend the DMD so that one can analyze the time-series data with power-low memory effects, which is seen in various phenomena e.g., viscoelastic matter, fluid dynamics with surface effects, and the mechanical slider with grease. We thus developed fractional DMD, a DMD-based method with arbitrary (real-value) order differential operations. We want to emphasize the fact that you can actually optimize the order of the equation with a standard optimization algorithm, so that one get the order of the equation that best explains the nature of the time-series data. This is also true for any DMDm method with a parameterized time-evolution model. We demonstrated the results for the synthetic data, and successfully estimated the model parameters.

The proposed method is expected to be useful not only for the scientific use, but also for model estimation, control and failure detection of mechanical, thermal and fluid systems in factory machines, such as in modern semiconductor manufacturing equipment.

Conflicts of Interest Disclosure

We declare that we have no conflicts of interest.

Downloads *Displays the aggregated results up to the previous day.

Download data is not yet available.

Author Biography

Ryoji Anzaki, AI Development Department, System Development Center, Tokyo Electron Ltd.

2016-2020: Graduate School of Engineering, The University of Tokyo (PhD)

2020-2021: Project Researcher, Earthquake Research Institute, The University of Tokyo

2021-Current: Scientist, Tokyo Electron Ltd.

References

T. Askham and J. N. Kutz, Variable projection methods for an optimized dynamic mode decomposition, SIAM Journal on Applied Dynamical Systems, 17 (2018), pp. 380–416.

S. L. Brunton, M. Budišić, E. Kaiser, and J. N. Kutz, Modern Koopman theory for dynamical systems, arXiv preprint arXiv:2102.12086, (2021).

S. Burov and E. Barkai, Fractional Langevin equation: Overdamped, underdamped, and critical behaviors, Physical Review E, 78 (2008), p. 031112.

H. J. Haubold, A. M. Mathai, and R. K. Saxena, Mittag-Leffler functions and their applications, Journal of applied mathematics, 2011 (2011).

A. A. Kilbas, H. M. Srivastava, and J. J. Trujillo, Theory and applications of fractional differential equations, vol. 204, elsevier, (2006).

D. Matignon, Stability results for fractional differential equations with applications to control processing, in Computational engineering in systems applications, vol. 2, Citeseer, 1996, pp. 963–968.

I. Mezić, Spectral properties of dynamical systems, model reduction and decompositions, Nonlinear Dynamics, 41 (2005), pp. 309–325.

I. Mezic, Analysis of fluid flows via spectral properties of the Koopman operator, Annual Review of Fluid Mechanics, 45 (2013), pp. 357–378.

I. Podlubny, Fractional-order systems and pi/sup /spl lambda//d/sup /spl mu//-controllers, IEEE Transactions on Automatic Control, 44 (1999), pp. 208–214.

J. L. Proctor, S. L. Brunton, and J. N. Kutz, Dynamic mode decomposition with control, SIAM Journal on Applied Dynamical Systems, 15 (2016), pp. 142–161.

E. Rodrigues, B. Zadrozny, C. Watson, and D. Gold, Decadal forecasts with resdmd: a residual DMD neural network, arXiv preprint arXiv:2106.11111, (2021).

C. W. Rowley, I. Mezić, S. Bagheri, P. Schlatter, and D. S. Henningson, Spectral analysis of nonlinear flows, Journal of fluid mechanics, 641 (2009), pp. 115–127.

I. Sakata, T. Sakata, K. Mizoguchi, S. Tanaka, G. Oohata, I. Akai, Y. Igarashi, Y. Nagano, and M. Okada, Complex energies of the coherent longitudinal optical phonon–plasmon coupled mode according to dynamic mode decomposition analysis, Scientific Reports, 11 (2021), pp. 1–10.

A. A. K. Samko, Stefan G. and O. I. Marichev, Fractional integrals and derivatives: theory and applications, Gordon and Breach Science Publishers, 1993.

M. Sasaki, Y. Kawachi, R. Dendy, H. Arakawa, N. Kasuya, F. Kin, K. Yamasaki, and S. Inagaki, Using dynamical mode decomposition to extract the limit cycle dynamics of modulated turbulence in a plasma simulation, Plasma Physics and Controlled Fusion, 61 (2019), p. 112001.

D. Sashidhar and J. N. Kutz, Bagging, optimized dynamic mode decomposition for robust, stable forecasting with spatial and temporal uncertainty quantification, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 380 (2022), p. 20210199.

P. J. Schmid, Dynamic mode decomposition of numerical and experimental data, Journal of fluid mechanics, 656 (2010), pp. 5–28.

P. J. Schmid, Dynamic mode decomposition and its variants, Annual Review of Fluid Mechanics, 54 (2022), pp. 225–254.

A. A. Stanislavsky, Fractional oscillator, Phys. Rev. E, 70 (2004), p. 051103.

N. Sugimoto and T. Horioka, Dispersion characteristics of sound waves in a tunnel with an array of Helmholtz resonators, Journal of the Acoustical Society of America, 97 (1995), pp. 1446–1459.

A. Svenkeson, B. Glaz, S. Stanton, and B. J. West, Spectral decomposition of nonlinear systems with memory, Phys. Rev. E, 93 (2016), p. 022211.

V. E. Tarasov, General fractional dynamics, Mathematics, 9 (2021), p. 1464.

J. Tenreiro Machado and A. Azenha, Fractional-order hybrid control of robot manipulators, in SMC’98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218), vol. 1, 1998, pp. 788–793 vol.1.

J. H. Tu, C. W. Rowley, D. M. Luchtenburg, S. L. Brunton, and J. N. Kutz, On dynamic mode decomposition: Theory and applications, Journal of Computational Dynamics, 1 (2014), pp. 391–421.

Downloads

Posted


Submitted: 2022-11-16 02:50:15 UTC

Published: 2022-11-17 02:11:15 UTC — Updated on 2022-12-27 00:38:44 UTC

Versions

Reason(s) for revision

Added appendices, minor updates, fixed typos, and added Ref. [5].
Section
Information Sciences