text
On the  2nd of October a really cool paper was released called "Were RNNs all we need"   
On the  2nd of October a really cool paper was released called "Were RNNs all we need"   
link
https://arxiv.org/abs/2410.01201
https://arxiv.org/abs/2410.01201
new_line
new_line
text
This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.
This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.
new_line
new_line
text
So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 
So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 
new_line
new_line
text
-  
-  
resource
https://huggingface.co/spaces/damerajee/mingru-stories
space
damerajee/mingru-stories
https://huggingface.co/spaces/damerajee/mingru-stories
text
new_line
On the  2nd of October a really cool paper was released called "Were RNNs all we need"   https://arxiv.org/abs/2410.01201

This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.

So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 

-  https://huggingface.co/spaces/damerajee/mingru-stories 

👀
John6666
/avatars/7c7860afb1bef5657f006cc75609e7d7.svg
Elvis Serge
NSAA
user