Aleph Alpha Releases Kolibri: A 78.1B Open-Weight English-German MoE Model With Only 3.46B Active Parameters
Aleph Alpha's Kolibri is a 78.1B open-weight English-German MoE model with 3.46B active parameters and 1M token context.
MarkTechPost · Asif Razzaq · https://www.facebook.com/MarkTechPost/