espnet3.parallel.parallel.build_local_gpu_cluster

source

espnet3.parallel.parallel.build_local_gpu_cluster(n_workers: int, options: dict) → Client

Create a Dask LocalCUDACluster using available GPUs.

This requires dask_cuda package.

• Parameters:
  • n_workers (int) – Number of Dask workers (must not exceed number of GPUs).
  • options (dict) – Additional options for the LocalCUDACluster.
• Returns: Dask client connected to the GPU cluster.
• Return type: Client
• Raises:
  • RuntimeError – If Dask or dask_cuda is unavailable.
  • ValueError – If n_workers exceeds the available GPU count.

Example

>>> client = make_local_gpu_cluster(1, options={})