lm_calc_perplexity.py
Less than 1 minute
lm_calc_perplexity.py
Calc perplexity
usage: lm_calc_perplexity.py [-h] [--config CONFIG] [--log_level {CRITICAL,ERROR,WARNING,INFO,DEBUG,NOTSET}] --output_dir OUTPUT_DIR
[--ngpu NGPU] [--seed SEED] [--dtype {float16,float32,float64}] [--num_workers NUM_WORKERS]
[--batch_size BATCH_SIZE] [--log_base LOG_BASE] --data_path_and_name_and_type DATA_PATH_AND_NAME_AND_TYPE
[--key_file KEY_FILE] [--allow_variable_data_keys ALLOW_VARIABLE_DATA_KEYS] [--train_config TRAIN_CONFIG]
[--model_file MODEL_FILE]