espnet2.asr_transducer.encoder.building.build_positional_encoding

source

espnet2.asr_transducer.encoder.building.build_positional_encoding(block_size: int, configuration: Dict[str, Any]) → RelPositionalEncoding

Build positional encoding block.

This function creates a positional encoding module, which is used in transformer architectures to inject information about the position of tokens in the input sequence. The positional encoding helps the model understand the order of tokens.

• Parameters:
  • block_size – Input/output size of the positional encoding.
  • configuration – A dictionary containing the positional encoding configuration parameters.
• Returns: An instance of the positional encoding module.
• Return type:RelPositionalEncoding

Examples

>>> config = {'pos_enc_dropout_rate': 0.1, 'pos_enc_max_len': 1000}
>>> pos_enc = build_positional_encoding(512, config)
>>> print(pos_enc)