bing_li
Use the Bing Li “ladle” diagnostic to truncate subspace
Specification
Alias: None
Arguments: None
Description
Uses a trade-off criterion to determine where to truncate the active subspace. The criterion is a function of the eigenvalues and eigenvectors of the active subspace gradient matrix. This function compares the decrease in eigenvalue amplitude with the increase in eigenvector variability under bootstrap sampling of the gradient matrix. The active subspace size is taken to be the index of the first minimum of this quantity.
Usage Tips
If this automated diagnostic does not yield desirable results, consider
using the explicit dimension
truncation option or one of the other
truncation methods.
Theory
Below is a brief outline of the Bing Li method of active subspace identification. The first two steps are common to all active subspace truncation methods.
- Compute the gradient of the quantity of interest, \(q = f(\mathbf{x})\) ,
at several locations sampled from the input space,
Compute the eigendecomposition of the matrix \(\hat{\mathbf{C}}\) ,
- where \(\hat{\mathbf{W}}\) has eigenvectors as columns,
\(\hat{\mathbf{\Lambda}} = \text{diag}(\hat{\lambda}_1,\:\ldots\:,\hat{\lambda}_N)\) contains eigenvalues, and \(N\) is the total number of parameters.
Normalize the eigenvalues,
- Use bootstrap sampling of the gradients found in step 1 to compute replicate
eigendecompositions,
Compute variability of eigenvectors,
- where \(\hat{\mathbf{W}}_i\) and \(\hat{\mathbf{W}}_{j,i}^*\) both
contain only the first \(i\) eigenvectors and \(M_{boot}\) is the number of bootstrap samples. The value of the variability at the first index, \(f_1^0\) , is defined as zero.
Normalize the eigenvector variability,
The criterion, \(g_i\) , is defined as,
- The index of first minimum of \(g_i\) is then the estimated active
subspace rank.
For additional information, see Luo, Wei, and Bing Li. “Combining eigenvalues and variation of eigenvectors for order determination.” SIAM, 2015.