espnet2.sds.end_to_end.mini_omni.inference.OmniInference
Less than 1 minute
espnet2.sds.end_to_end.mini_omni.inference.OmniInference
class espnet2.sds.end_to_end.mini_omni.inference.OmniInference(ckpt_dir='./checkpoint', device='cuda:0')
Bases: object
run_AT_batch_stream(audio_path, stream_stride=4, max_returned_tokens=2048, temperature=0.9, top_k=1, top_p=1.0, eos_id_a=4096, eos_id_t=151936)
warm_up(sample='./data/samples/output1.wav')
