espnet2.sds.end_to_end.mini_omni.litgpt.utils.estimate_flops

source

espnet2.sds.end_to_end.mini_omni.litgpt.utils.estimate_flops(model: GPT, training: bool) → int

Measures estimated FLOPs for MFU.

Refs: : * https://ar5iv.labs.arxiv.org/html/2205.05198#A1

• https://ar5iv.labs.arxiv.org/html/2204.02311#A2