Recurrent Layers Reference

This page documents all custom recurrent layers provided in the torchrecurrent.

torchrecurrent.AntisymmetricRNN	Multi-layer antisymmetric recurrent neural network.
torchrecurrent.GatedAntisymmetricRNN	Multi-layer gated antisymmetric recurrent neural network.
torchrecurrent.NBR	Multi-layer neuromodulated bistable recurrent neural network.
torchrecurrent.BR	Multi-layer bistable recurrent neural network.
torchrecurrent.CFN	Multi-layer chaos free recurrent neural network.
torchrecurrent.DSGU	Multi-layer Deep Simple Gated Unit neural network.
torchrecurrent.eLSTM	Multi-layer LSTM with element-wise recurrence (eLSTM).
torchrecurrent.coRNN	Multi-layer coupled oscillatory recurrent neural network.
torchrecurrent.FastRNN	Multi-layer fast recurrent neural network.
torchrecurrent.FastGRNN	Multi-layer FastGRNN.
torchrecurrent.ATR	Multi-layer additive–transform recurrent neural network.
torchrecurrent.IndRNN	Multi-layer independently recurrent neural network.
torchrecurrent.IntersectionRNN	Multi-layer Intersection RNN (+RNN).
torchrecurrent.JANET	Multi-layer JANET (Just Another NETwork) recurrent neural network.
torchrecurrent.LEM	Multi-layer long expressive memory recurrent neural network.
torchrecurrent.LightRU	Multi-layer light recurrent unit neural network.
torchrecurrent.LiGRU	Multi-layer light gated recurrent unit neural network.
torchrecurrent.MCLSTM	Multi-layer memory-controller LSTM (MC-LSTM).
torchrecurrent.MGU	Multi-layer minimal gated unit neural network.
torchrecurrent.MGU1	Multi-layer minimal gated unit variant 1 (MGU1) network.
torchrecurrent.MGU2	Multi-layer minimal gated unit variant 2 (MGU2) network.
torchrecurrent.MGU3	Multi-layer minimal gated unit variant 3 (MGU3) network.
torchrecurrent.MinimalRNN	Multi-layer minimal recurrent neural network.
torchrecurrent.MiRU1	Multi-layer Minion Gated Unit 1 (MiRU1) neural network.
torchrecurrent.MiRU2	Multi-layer Minion Gated Unit 2 (MiRU2) neural network.
torchrecurrent.MultiplicativeLSTM	Multi-layer multiplicative long short-term memory network.
torchrecurrent.MUT1	Multi-layer mutated unit type 1 recurrent network.
torchrecurrent.MUT2	Multi-layer mutated unit type 2 recurrent network.
torchrecurrent.MUT3	Multi-layer mutated unit type 3 recurrent network.
torchrecurrent.NAS	Multi-layer neural architecture search recurrent network.
torchrecurrent.OriginalLSTM	Multi-layer original long short-term memory (LSTM) network.
torchrecurrent.PeepholeLSTM	Multi-layer peephole long short-term memory (LSTM) network.
torchrecurrent.RAN	Multi-layer Recurrent Additive Network (RAN).
torchrecurrent.ResLSTM	Multi-layer residual long short-term memory (LSTM) network.
torchrecurrent.SCRN	Multi-layer Structurally Constrained Recurrent Network (SCRN).
torchrecurrent.SGU	Multi-layer Simple Gated Unit neural network.
torchrecurrent.SGRN	Multi-layer Simple Gated Recurrent Network (SGRN).
torchrecurrent.STAR	Multi-layer Stackable Recurrent (STAR) network.
torchrecurrent.tauGRU	Multi-layer tau-GRU neural network.
torchrecurrent.TRNN	Multi-layer strongly typed recurrent neural network (T-RNN).
torchrecurrent.TGRU	Multi-layer strongly typed gated recurrent unit (T-GRU).
torchrecurrent.TLSTM	Multi-layer strongly typed long short-term memory (T-LSTM).
torchrecurrent.UGRNN	Multi-layer Update Gate Recurrent Neural Network (UGRNN).
torchrecurrent.UnICORNN	Multi-layer Undamped Independent Controlled Oscillatory RNN (UnICORNN).
torchrecurrent.WMCLSTM	Multi-layer LSTM with working-memory connections (WMCLSTM).