LMIs in Control/pages/Inverse Problem of Optimal Control

LMIs in Control/pages/Inverse Problem of Optimal Control

In some cases, it is needed to solve the inverse problem of optimal control within an LQR framework. In this inverse problem, a given controller matrix needs to be verified for the system by assuring that it is the optimal solution to some LQR optimization problem that is controllable and detectable. In other words: in this inverse problem, the controller is known and the LQR gain matrices are to be calculated such that the controller is the optimal solution.

The System

The system is a linear time-invariant system, that can be represented in state space as shown below:

$\begin{array}{cc}\dot{x}& =Ax+Bu,\\ z& =\left[\begin{array}{cc}{Q}^{1/2}& 0\\ 0& R^{1/2}\end{array}\right]\left[\begin{array}{c}x\\ u\end{array}\right]\end{array}$

where $x\in R^n,y\in R^l,z\in R^m$ represent the state vector, the measured output vector, and the output vector of interest, respectively, $w\in R^p$ is the disturbance vector, and $A,B,C,Q,R$ are the system matrices of appropriate dimension. To further define: $x$ is $\in R^n$ and is the state vector, $A$ is $\in R^{n*n}$ and is the state matrix, $B$ is $\in R^{n*r}$ and is the input matrix, $w$ is $\in R^r$ and is the exogenous input, $C,Q,R$ is $\in R^{m*n}$ and are the output matrices, and $y$ and $z$ are $\in R^m$ and are the output and the output of interest, respectively.

The Data

The matrices $A,B,C$ that define the system, and a given controller $K$ for which the inverse problem is to be solved.

The Optimization Problem

In this LMI, the following cost function is to be minimized for a given controller K by finding an optimal input:

$\begin{array}{c}\underset{0}{\overset{\mathrm{\infty }}{\int }}{z}^{T}zdt\end{array}$

the solution of the problem can be formulated as a state feedback controller given as:

$\begin{array}{cc}K& =-R^{-1}{B}^{T}P,\\ A^{T}P+PA-PB{R}^{-1}{B}^{T}P+Q& =0\end{array}$

The LMI: Inverse Problem of Optimal Control

the inverse problem of optimal control is the following: Given a matrix $K$, determine if there exist $Q\ge 0$ and $R>0$, such that $(Q,A)$ is detectable and $u=Kx$ is the optimal control for the corresponding LQR problem. Equivalently, we seek $R>0$ and $Q\ge 0$ such that there exist $P$ nonnegative and $P_1$ positive-definite satisfying

$\begin{array}{cc}(A+BK{)}^{T}P+P(A+BK)+K^{T}RK+Q& =0\\ B^{T}P+RK& =0\\ A^T{P}_1+P_{1}A& <Q\end{array}$

Conclusion:

If the solution exists, then $K$ is the optimal controller for the LQR optimization on the matrices $Q$ and $R$

Implementation

This implementation requires Yalmip and Sedumi.

https://github.com/rezajamesahmed/LMImatlabcode/blob/master/inverseprob.m

Related LMIs

1. Multi-Criterion LQG]

External Links

• LMI Methods in Optimal and Robust Control - A course on LMIs in Control by Matthew Peet.
• LMI Properties and Applications in Systems, Stability, and Control Theory - A List of LMIs by Ryan Caverly and James Forbes.
• LMIs in Systems and Control Theory - A downloadable book on LMIs by Stephen Boyd.