Optimizing Rayleigh quotient with symmetric constraints and its application to eigenvalue backward errors of polynomial and rational eigenvalue problems
Anshul Prajapati, Punit Sharma
Abstract
Let \(H \in \mathbb {C}^{n,n}\) be Hermitian and \(S_0,S_1,\ldots ,S_k \in \mathbb {C}^{n,n}\) be symmetric matrices. We consider the problem of maximizing the Rayleigh quotient of \(H\) with respect to certain constraints involving symmetric matrices \(S_0,S_1,\ldots ,S_k\). More precisely, we compute
\(\seteqnumber{0}{}{0}\)
\begin{align}
\label {eq:cenprob} m_{hs_0s_1\ldots s_k}(H,S_0,S_1,\ldots ,S_k):=\sup \bigg \{ &\frac {v^*Hv}{v^*v} :~v\in \mathbb {C}^{n} \setminus \{0\},\,v^TS_iv=0 \nonumber \\ & \text {for}~i=0,\ldots ,k \bigg \},
\tag {$\mathcal {P}$}
\end{align}
where \(T\) and \(*\) denote respectively the transpose and the conjugate transpose of a matrix or a vector.
Such problems occur in stability analysis of uncertain systems and in the eigenvalue perturbation theory of matrices and matrix polynomials [3, 4]. A particular case of problem (\(\mathcal {P}\)) with only one symmetric constraint (i.e., when \(k=0\)) is used to characterize the \(\mu \)-value of the matrix under skew-symmetric perturbations [4]. An explicit computable
formula was obtained for \(m_{hs_0}(H,S_0)\) in [4, Theorem 6.3] and given by
\begin{equation*} \label {eq:mikaresult} m_{hs_0}(H,S_0)=\inf _{t\in [0,\infty )} \lambda _2\left (\begin{bmatrix} H & t\overline S_0 \\ t S_0 & \overline H \end {bmatrix}\right ), \end{equation*}
where \(\lambda _2(A)\) stands for the second largest eigenvalue of a Hermitian matrix \(A\). However, the solution to the problem (\(\mathcal {P}\)) with more
than one symmetric constraint was not known.
We derive an explicit computable formula for (\(\mathcal {P}\)) in terms of minimizing the second largest eigenvalue of a parameter-depending Hermitian matrix
under a simplicity assumption. The results are then applied to derive computable formulas for the structured eigenvalue backward errors of rational matrix functions (RMFs) of the following form
\begin{equation*} G(z) = A_0+zA_1+\cdots z^d A_d + \frac {s_1(z)}{q_1(z)}E_1+\cdots +\frac {s_k(z)}{q_k(z)}E_k \end{equation*}
where the coefficients \(A_p,p=0,1,\ldots ,d\) and \(E_j,j=1,2,\ldots ,k\) are \(n\times n\) matrices, and \(s_j(z)\), \(q_j(z),\) for \(j=1,2,\ldots ,k\) are scalar polynomials.
Eigenvalue backward errors of matrix polynomials, both for unstructured and structure-preserving perturbations, have been studied in the literature; see [9] for unstructured, [1] for Hermitian and related structures, and [2] for
palindromic and related structures. However, the literature on RMFs is relatively limited, and the structured eigenvalue backward errors have not been explored before.
To explore this, we first aim to reformulate the problem of computing structured eigenvalue backward errors for RMFs with symmetric, skew-symmetric, T-even, T-odd, and T-palindromic structures into the optimization problem (\(\mathcal {P}\)). We then apply the results obtained for this optimization problem to derive computable formulas for the structured eigenvalue backward errors of RMFs. As a
specific case of RMFs, formulas for the structured eigenvalue backward errors of matrix polynomials with the aforementioned structures can also be derived. Numerical experiments suggest that our results [5] provide a more accurate estimation
of the supremum in (\(\mathcal {P}\)) compared to the one in [7]. Some of these results are published in Linear Algebra and its Applications [5], while
others in BIT Numerical Mathematics [6].
References
-
[1] S. Bora, M. Karow, C. Mehl, P. Sharma. Structured eigenvalue backward errors of matrix pencils and polynomials with Hermitian and related structures. SIAM J. Matrix Anal. Appl., 35: 453–475 (2014).
-
[2] S. Bora, M. Karow, C. Mehl, P. Sharma. Structured eigenvalue backward errors of matrix pencils and polynomials with palindromic structures. SIAM J. Matrix Anal. Appl., 36: 393–416 (2015).
-
[3] J. Doyle. Analysis of feedback systems with structured uncertainties. IEE Proc. Part D, Control Theory Appl., 129: 242–250 (1982).
-
[4] M. Karow. \(\mu \)-values and spectral value sets for linear perturbation classes defined by a scalar product. SIAM J. Matrix Anal. Appl., 32: 845–865 (2011).
-
[5] A. Prajapati, P. Sharma. Optimizing the Rayleigh quotient with symmetric constraints and its application to perturbations of structured polynomial eigenvalue problems. Linear Algebra Appl., 645: 256–277 (2022).
-
[6] A. Prajapati, P. Sharma. Structured eigenvalue backward errors for rational matrix functions with symmetry structures, BIT Numer Math, 64, 10 (2024).
-
[7] P. Sharma. Eigenvalue Backward errors of polynomial eigenvalue problems under structure preserving perturbations. PhD thesis, Department of Mathematics, Indian Institute of Technology Guwahati, India, (2016).
-
[8] F. Tisseur, K. Meerbergen. The quadratic eigenvalue problem. SIAM Review, 43: 235–286 (2001).
-
[9] F. Tisseur. Backward error and condition of polynomial eigenvalue problems. Linear Algebra Appl., 309: 339–361 (2000).