Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models
AI & ML interests
None defined yet.
Recent Activity
models 14
open-lm-engine/gdn-7b
7B • Updated • 3 • 1
open-lm-engine/hybrid-gdn-7b
7B • Updated • 3 • 1
open-lm-engine/hybrid-gdn-m2rnn-1l-7b
7B • Updated • 3 • 1
open-lm-engine/hybrid-gdn-m2rnn-5l-7b
7B • Updated • 3 • 1
open-lm-engine/hybrid-m2rnn-7b
7B • Updated • 2 • 1
open-lm-engine/m2rnn-7b
7B • Updated • 4 • 2
open-lm-engine/transformer-7b
7B • Updated • 2 • 1
open-lm-engine/gdn-400m
0.4B • Updated • 3 • 1
open-lm-engine/hybrid-gdn-m2rnn-3l-400m
0.4B • Updated • 2 • 1
open-lm-engine/hybrid-gdn-m2rnn-1l-400m
0.4B • Updated • 2 • 1