espnet3.parallel.base_runner.AsyncJobSpec

source

class espnet3.parallel.base_runner.AsyncJobSpec(runner_cls: str, provider_cls: str, config: Dict, params: Dict, indices: List[int], world_size: int, world_rank: int, result_path: str | None, extras: Dict | None)

Bases: object

Specification of an asynchronous shard submitted to the Dask cluster.

runner_cls

Import path to the concrete BaseRunner subclass.

• Type: str

provider_cls

Import path to the concrete EnvironmentProvider subclass

• Type: str

config

A resolved, plain-dict serialization of the Hydra config.

• Type: Dict

params

Extra parameters forwarded to the provider/environment.

• Type: Dict

indices

The subset of indices this shard should process.

• Type: List[int]

world_size

Total number of shards.

• Type: int

world_rank

The shard rank (0..world_size-1).

• Type: int

result_path

If set, results are written to this JSONL file on the worker and not returned to the driver.

• Type: str | None

extras

Reserved for future extensions.

• Type: Dict | None

Notes

• Each shard is independent and reconstructs both provider and runner by import path on the worker before executing BaseRunner.forward().

config

*: Dict*

extras

*: Dict | None*

indices

*: List[int]*

params

*: Dict*

provider_cls

*: str*

result_path

*: str | None*

runner_cls

*: str*

world_rank

*: int*

world_size

*: int*