shipfeedAI news, curated daily

02:53:49 CET
12 OCT02:53:49shipfeed⋯
pull to refreshlast sync
Just in — 30 new
§ models · storyline

Adds Nemotron 3 Diarization, NemotronH Omni, HyperCLOVAX Vision, GTE

Nemotron 3 Diarization, NemotronH Omni, and HyperCLOVAX Vision multimodal models are now available.

Sep 30 · · primary fetch1 sourceupdated Sep 30 ·

New Model additions Nemotron 3 Diarization Nemotron 3 Diarization is an open-weight streaming speaker diarization model designed to determine "who spoke when" in real-world audio. It supports both streaming and offline inference, handles up to eight speakers, and orders speaker outputs by each speaker's first arrival in the input audio. The model uses the Arrival-Order Speaker Cache (AOSC) 1 and FIFO queue introduced for Streaming Sortformer 1, 2. A single checkpoint supports configurable latency profiles, from an 80 ms input buffer to a 30.4 s offline-style buffer, and configurable output frame resolution in multiples of 10 ms.

With chunked inference, the maximum audio duration is not limited. Links: Documentation Add Nemotron3Diarization (#49056) by @eustlb in #49056 NemotronH Omni NemotronH Omni is a multimodal reasoning model from NVIDIA that pairs the NemotronH hybrid Mamba-Transformer language model with a RADIO vision encoder and an optional Parakeet-based sound encoder. Image (and video) patches are projected through a RADIO tower and a pixel-shuffle MLP into the language model's embedding space at the `` / `` context-token positions; audio clips are projected in the same…

read full article on github.com ↗
§ sources1 publication · timeline below
  1. github.comTransformers: Release 5.18.0primary