cost_recovery_metadata
Identify metadata by label for capturing online cost estimates
Specification
Alias: None
Arguments: STRING
Description
Metadata can be used for a variety of response annotation purposes, including the online recovery of simulation cost (using facilities either implemented in a user’s analysis driver or codified in an embedded test driver). This information can then be used by certain algorithms that allocate resources based on relative cost, e.g. multifidelity UQ methods.
Cost estimates may be provided a priori, e.g. using solution_level_cost,
in cases where they can be assumed fixed for each model form and/or
resolution. In cases such as model tuning over a set of hyper-parameters,
costs will generally be a function of these hyper-parameters and need to
be captured online during initialization of the algorithm (e.g. during
evaluation of the pilot sample).
Default Behavior No recovery of cost estimates from the response metadata.
Usage Tips It is common to employ total CPU time, aggregated across all computing cores involved in a (parallel) simulation instance. Wall time, even when the number of cores is fixed, can be subject to additional variability due to system load.
Examples
model,
id_model = 'TUNABLE_LF'
simulation
cost_recovery_metadata = 'core_time'
responses,
response_functions = 1
descriptors = 'Q'
no_gradients
no_hessians
metadata 'core_time'
