espnet2.legacy.nets.pytorch_backend.transformer.positionwise_feed_forward.PositionwiseFeedForward

source

class espnet2.legacy.nets.pytorch_backend.transformer.positionwise_feed_forward.PositionwiseFeedForward(idim, hidden_units, dropout_rate, activation=ReLU())

Bases: Module

Positionwise feed forward layer.

• Parameters:
  • idim (int) – Input dimenstion.
  • hidden_units (int) – The number of hidden units.
  • dropout_rate (float) – Dropout rate.

Construct an PositionwiseFeedForward object.

forward(x)

Forward function.