Skip to content

Commit 474c92e

Browse files
mtmd: correcting duplicate empty audio chunks for short inputs (ggml-org#26536)
* correcting duplicate empty audio chunks for short inputs * tests.sh code restored
1 parent a6aa6f5 commit 474c92e

1 file changed

Lines changed: 2 additions & 4 deletions

File tree

‎tools/mtmd/mtmd-audio.cpp‎

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -556,10 +556,8 @@ bool mtmd_audio_preprocessor_whisper::preprocess(const float * s
556556
}
557557

558558
std::vector<float> smpl;
559-
// if input is too short, pad with zeros
560-
// this is to avoid potential issues with stage1/2 padding in log_mel_spectrogram
561-
// TODO: maybe handle this better
562-
size_t min_samples = (size_t) hparams.audio_sample_rate * (hparams.audio_chunk_len + 1); // +1 second margin
559+
// reflection padding needs one sample plus half an FFT window
560+
size_t min_samples = (size_t) hparams.audio_n_fft / 2 + 1;
563561
if (n_samples < min_samples) {
564562
smpl.resize(min_samples, 0.0f);
565563
std::memcpy(smpl.data(), samples, n_samples * sizeof(float));

0 commit comments

Comments
 (0)