Commit Graph
15 Commits
Author SHA1 Message Date
iamdoubz 403d652c6d style: cargo fmt sweep (reflow-only; verified rustfmt(HEAD) == worktree per file) 2026-07-15 20:36:48 -05:00
iamdoubz 95f07e1dba fix(transcription): scope streamer-test closures so out isn't borrow-locked 2026-07-11 09:08:20 -05:00
iamdoubz 12e23143f6 feat(transcription): streaming growing-window + interim + commit-on-pause (FR-TRX-2) 2026-07-11 08:42:24 -05:00
iamdoubz 469df7524f fix(transcription): drop whisper-hallucinated segments on silent windows 2026-07-10 18:51:08 -05:00
iamdoubz 40709b257d fix(transcription): resolve_language normalizes case-insensitive "en" match (T8.7, M4.2)
resolve_language(Some("EN"), false) was passed through unchanged instead of
being normalized to lowercase "en" - the English-only-model guard only fired
when the requested language *differed* from English, not when it matched with
different casing. Also fixes cargo fmt drift in mod.rs/npu.rs left over from
the M4.2 worktree (stopped mid-verification per session instruction before
running fmt).
2026-07-07 13:59:55 -05:00
iamdoubz 496a8aa29b feat(transcription): wire whisper language param through Transcriber trait (T8.7, M4.2) 2026-07-07 13:00:52 -05:00
iamdoubz eb87bf4edb refactor(transcription): re-export OnnxTranscriber; note ONNX tier covers NPU+DirectML (P2) 2026-07-05 19:40:17 -05:00
iamdoubz 02a215c2e3 test(transcription): GPU/CPU timing spike (opt-in) for whisper.cpp backends 2026-07-05 00:36:33 -05:00
iamdoubz 92752698c5 refactor(transcription): let streaming worker take &dyn Transcriber (T3.4) 2026-07-02 17:16:43 -05:00
iamdoubz f58c0f2d6c feat(transcription): wire OnnxNpuTranscriber behind npu feature (T3.4) 2026-07-02 16:14:16 -05:00
iamdoubz 8530a22899 fix(transcription): reduce whisper.cpp encoder cost per streaming window
whisper.cpp's encoder always runs over a full, padded 30s mel window
(1500 encoder positions) unless audio_ctx is explicitly reduced. The
~4s live-transcription streaming windows were never setting it, so
every window paid the full 30s-equivalent encode cost on one serial
worker thread -- the actual cause of the reported 30-65s lag between
speaking and a segment appearing, not "CPU is just slow".

Scales audio_ctx proportionally to the window's real sample count
instead (audio_ctx_for_window), floored and capped to whisper.cpp's
own valid range. Verified with a controlled A/B against the real
base.en-q5_1 model: ~30% faster even under heavy concurrent CPU
contention on this machine, which is masking most of the improvement
--the fix targets the encoder's O(n^2)-ish attention cost specifically
(1500 -> ~201 positions for a 4s window), so the gain on an otherwise-
idle machine should be substantially larger.
2026-07-02 15:02:02 -05:00
iamdoubz ba48f0afc2 Phase 3 2026-06-30 23:53:33 -05:00
iamdoubz f9b172aff4 Phase 2 2026-06-30 23:18:29 -05:00
iamdoubz 02834e9cd2 Phase 1 2026-06-30 22:17:30 -05:00
iamdoubz aae22a0e23 Add all scaffolding, design, and decision documentation AKA first commit 2026-06-30 16:12:55 -05:00