shipfeedAI news, curated daily

23:54:53 CET
20 MAY23:54:53shipfeed
pull to refreshlast sync
Just in — 30 new
§ feed · storyline

Grok-1 in Bio

xAI releases Grok-1, a 314B parameter mixture-of-experts model, under an Apache 2.0 licence, with weights and code publicly available for community use.

Mar 19 · · primary fetch1 sourceupdated Mar 19 ·

Grok-1, a 314B parameter Mixture-of-Experts (MoE) model from xAI, has been released under an Apache 2.0 license, sparking discussions on its architecture, finetuning challenges, and performance compared to models like Mixtral and Miqu 70B. Despite its size, its MMLU benchmark performance is currently unimpressive, with expectations that Grok-2 will be more competitive. The model's weights and code are publicly available, encouraging community experimentation.

Sam Altman highlighted the growing importance of compute resources, while Grok's potential deployment on Groq hardware was noted as a possible game-changer. Meanwhile, Anthropic's Claude continues to attract attention for its "spiritual" interaction experience and consistent ethical framework. The release also inspired memes and humor within the AI community.

read full article on news.smol.ai
§ sources1 publication · timeline below
  1. news.smol.aiGrok-1 in Bioprimary