espnet3.systems.base.metric.measure

source

espnet3.systems.base.metric.measure(metrics_config: DictConfig)

Compute metrics for each test set and write a metrics JSON file.

Test sets are resolved in the following order:

1. If metrics_config.dataset.test is defined, use the configured name fields as-is.
2. Otherwise, scan metrics_config.inference_dir and treat each non-hidden subdirectory as a test set.

Example

If inference_dir contains:

exp/my_run/inference/
  test-clean/
  test-other/

then measure() scores both test-clean and test-other when metrics_config.dataset.test is omitted.

• Parameters:metrics_config – Omegaconf configuration with inference and metric settings.
• Returns: Nested dict keyed by metric class path and test set name.
• Raises:ValueError – If no test sets can be resolved from either metrics_config.dataset.test or metrics_config.inference_dir.