Stability Analysis of Feedback Systems with ReLU Nonlinearities via Semialgebraic Set Representation

التفاصيل البيبلوغرافية
العنوان: Stability Analysis of Feedback Systems with ReLU Nonlinearities via Semialgebraic Set Representation
المؤلفون: Nishinaka, Shingo, Saeki, Rin, Yuno, Tsuyoshi, Ebihara, Yoshio, Magron, Victor, Peaucelle, Dimitri, Zoboli, Samuele, Tarbouriech, Sophie
سنة النشر: 2024
المجموعة: Mathematics
مصطلحات موضوعية: Mathematics - Optimization and Control
الوصف: This paper is concerned with the stability analysis problem of feedback systems with rectified linear unit (ReLU) nonlinearities. Such feedback systems arise when we model dynamical (recurrent) neural networks (NNs) and NN-driven control systems where all the activation functions of NNs are ReLUs. In this study, we focus on the semialgebraic set representation characterizing the input-output properties of ReLUs. This allows us to employ a novel copositive multiplier in the framework of the integral quadratic constraint and, thus, to derive a linear matrix inequality (LMI) condition for the stability analysis of the feedback systems. However, the infeasibility of this LMI does not allow us to obtain any conclusion on the system's stability due to its conservativeness. This motivates us to consider its dual LMI. By investigating the structure of the dual solution, we derive a rank condition on the dual variable certificating that the system at hand is never stable. In addition, we construct a hierarchy of dual LMIs allowing for improved instability detection. We illustrate the effectiveness of the proposed approach by several numerical examples.
Comment: 8 pages, 5 figures
نوع الوثيقة: Working Paper
الوصول الحر: http://arxiv.org/abs/2403.04016Test
رقم الانضمام: edsarx.2403.04016
قاعدة البيانات: arXiv