Recurrent Cells Reference#

This page documents all custom recurrent cells provided in the torchrecurrent.cells module.

torchrecurrent.AntisymmetricRNNCell

An antisymmetric recurrent neural network cell.

torchrecurrent.GatedAntisymmetricRNNCell

A gated antisymmetric recurrent neural network (RNN) cell.

torchrecurrent.NBRCell

A Neuromodulated Bistable Recurrent cell.

torchrecurrent.BRCell

A Bistable recurrent cell.

torchrecurrent.CFNCell

A Chaos Free Network (CFN) cell.

torchrecurrent.DSGUCell

A Deep Simple Gated Unit (DSGU) cell.

torchrecurrent.eLSTMCell

An LSTM cell with element-wise recurrence (eLSTM).

torchrecurrent.coRNNCell

A Coupled Oscillatory RNN cell.

torchrecurrent.FastRNNCell

A Fast RNN cell with two scalar gates \(\alpha\) and \(\beta\).

torchrecurrent.FastGRNNCell

A "Fast RNN" cell with two scalar gates.

torchrecurrent.ATRCell

An Additive–Transform Recurrent cell.

torchrecurrent.IndRNNCell

An Independently Recurrent Neural Network (IndRNN) cell.

torchrecurrent.IntersectionRNNCell

An Intersection RNN (+RNN) cell.

torchrecurrent.JANETCell

A JANET (Just Another NETwork) recurrent cell.

torchrecurrent.LEMCell

A Long Expressive Memory (LEM) recurrent cell.

torchrecurrent.LightRUCell

A Light Recurrent Unit (LightRU) cell.

torchrecurrent.LiGRUCell

A Light Gated Recurrent Unit (LiGRU) cell.

torchrecurrent.MCLSTMCell

A memory-controller LSTM (MC-LSTM) cell.

torchrecurrent.MGUCell

A Minimal Gated Unit (MGU) cell.

torchrecurrent.MGU1Cell

A minimal gated unit variant 1 (MGU1) cell.

torchrecurrent.MGU2Cell

A minimal gated unit variant 2 (MGU2) cell.

torchrecurrent.MGU3Cell

A minimal gated unit variant 3 (MGU3) cell.

torchrecurrent.MinimalRNNCell

A Minimal recurrent neural network (MinimalRNN) cell.

torchrecurrent.MiRU1Cell

A Minion Gated Unit 1 (MiRU1) cell.

torchrecurrent.MiRU2Cell

A Minion Gated Unit 2 (MiRU2) cell.

torchrecurrent.MultiplicativeLSTMCell

A multiplicative LSTM cell.

torchrecurrent.MUT1Cell

A Mutated Unit Type 1 (MUT1) recurrent cell.

torchrecurrent.MUT2Cell

A Mutated Unit Type 2 (MUT2) recurrent cell.

torchrecurrent.MUT3Cell

A Mutated Unit Type 3 (MUT3) recurrent cell.

torchrecurrent.NASCell

A Neural Architecture Search (NAS) cell.

torchrecurrent.OriginalLSTMCell

Original formulation of the LSTM cell (no forget gate).

torchrecurrent.PeepholeLSTMCell

A Peephole LSTM cell with learnable peephole connections.

torchrecurrent.RANCell

A Recurrent Additive Network (RAN) cell.

torchrecurrent.ResLSTMCell

A residual long short-term memory (ResLSTM) cell.

torchrecurrent.SCRNCell

A Structurally Constrained Recurrent Network (SCRN) cell.

torchrecurrent.SGUCell

A Simple Gated Unit (SGU) cell.

torchrecurrent.SGRNCell

A Simple Gated Recurrent Network (SGRN) cell.

torchrecurrent.STARCell

A Stackable Recurrent (STAR) cell.

torchrecurrent.tauGRUCell

A tau-GRU cell with weighted time-delay feedback.

torchrecurrent.TRNNCell

A strongly typed recurrent neural network (T-RNN) cell.

torchrecurrent.TGRUCell

A strongly typed gated recurrent unit (T-GRU) cell.

torchrecurrent.TLSTMCell

A strongly typed long short-term memory (T-LSTM) cell.

torchrecurrent.UGRNNCell

An Update Gate RNN (UGRNN) cell.

torchrecurrent.UnICORNNCell

An Undamped Independent Controlled Oscillatory RNN (UnICORNN) cell.

torchrecurrent.WMCLSTMCell

A Long Short-Term Memory (LSTM) cell with working-memory connections.