recurrent weighted average (rwa)

An alternative to LSTMs and GRUs, the RWA model is designed for tasks that require the retention of memory of past inputs over long time scales.