shipfeedAI news, curated daily

04:41:40 CET
12 OCT04:41:40shipfeed⋯
pull to refreshlast sync
Just in — 30 new
§ local-llm · storyline

Fixes mel preprocessor accuracy in LFM2 audio transcription

LFM2 fixes mel preprocessor audio transcription accuracy for English and Japanese utterances.

Sep 25 · · primary fetch1 sourceupdated Sep 25 ·

mtmd: fix mel preprocessor in LFM2 audio (#29403) which resulted in different greedy transcripts for 4.5% of English and 6.5% of Japanese test utterances. In Japanese, some differences changed entire words. This change: uses `log(x + 2^-24)` instead of clamping to the log floor uses a symmetric Hann window, equivalent to `torch.hann_window(periodic=False)` adds the normalization epsilon to the standard deviation instead of inside the square root Only the `lfm2a` preprocessor opts into these behaviors. Other audio preprocessors are unchanged. Tested on top of 84e76d8 using `llama-server` with CUDA and `temperature=0`, compared against http://github.com/Liquid4All/liquid-audio fp32.

Test set: 200 LibriSpeech `test-clean` utterances (EN) 200 Common Voice `ja` test utterances (JP) identical 16 kHz audio passed to both implementations | Greedy transcript identical to `liquid-audio` | Without fix | With fix | | --------------------------------------------- | ----------: | ----------: | | EN F16 | 191/200 | 200/200 | | JP F32 | 187/200 | 200/200 | | JP F16 | 187/200 | 199/200 | The remaining JP F16 difference is a comma and matches the reference implementation's own bf16 output. Mel…

read full article on github.com ↗
§ sources1 publication · timeline below
  1. github.comllama.cpp b11190primary