shipfeedAI news, curated daily

00:38:18 CET
21 MAY00:38:18shipfeed
pull to refreshlast sync
Just in — 30 new
§ feed · storyline

The Era of 1-bit LLMs

Microsoft Research releases BitNet b1.58, a ternary-parameter LLM matching full-precision Transformer performance while cutting energy use by 38x, prompting new scaling laws and hardware designs.

Mar 1 · · primary fetch1 sourceupdated Mar 1 ·

The Era of 1-bit LLMs research, including the BitNet b1.58 model, introduces a ternary parameter approach that matches full-precision Transformer LLMs in performance while drastically reducing energy costs by 38x. This innovation promises new scaling laws and hardware designs optimized for 1-bit LLMs.

Discussions on AI Twitter highlight advances in AGI societal impact, robotics with multimodal models, fine-tuning techniques like ResLoRA, and AI security efforts at Hugging Face. Ethical considerations in generative AI and humor within the AI community are also prominent topics.

read full article on news.smol.ai
§ sources1 publication · timeline below
  1. news.smol.aiThe Era of 1-bit LLMsprimary