3 Commits

Include renames

Author	SHA1	Message	Date
jaredandClaude Opus 4.8	86272b6b08	fix(calls): wire DTLN ML denoise correctly via @workadventure JS API ... The prior DTLN attempt (89a2321d) broke the build (missing dep, wrong `cinny/` asset paths) and typecheck (`'dtln'` not in DenoiseModelId), and was wired against an API the package doesn't expose. @workadventure/noise- suppression is not a flat AudioWorklet — it's a self-contained ES module whose processor name is `workadventure-noise-suppression` and which resolves its own LiteRT WASM + TFLite models via import.meta.url. Driving it by hand-rolled addModule + processorOptions cannot work. - Re-add @workadventure/noise-suppression@0.0.4 (package.json + lockfile). - vite: copy the package's whole dist/ tree intact to denoise/workadventure/ (preserving assets/ + vendor/litert) so import.meta resolution works at runtime; fail the build if the entry module is missing. - shim: for the DTLN model, dynamic-import denoise/workadventure/audio-worklet .js and use createNoiseSuppressionAudioWorklet(ctx, { bypassUntilReady }) to build the node; RNNoise/Speex keep their direct flat-worklet path. Async init errors are logged + reported and fall back to the raw mic. - Restore 'dtln' in DenoiseModelId (+ settings coercion), the model chart, and the settings dropdown, labelled "(beta)". DTLN builds and is fully self-hosted, but its in-call audio is UNVERIFIED in this environment — needs a real-call test. DeepFilterNet stays excluded (CDN asset loading, incompatible with self-hosting / Tauri CSP). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-06-16 17:11:45 -04:00
jaredandClaude Opus 4.8	6634b2b8a2	fix(calls): make ML denoise build-honest + gate desktop trigger on CI ... Audit/repair of the multi-model denoise work so it actually builds and only exposes working, self-hosted models. - Complete the DTLN/DFN3 revert: uninstall @workadventure/noise-suppression and deepfilternet3-noise-filter (package.json + lockfile), drop the unused DTLN asset-copy block from vite.config.js (was shipping ~2MB of unused tflite/wasm), and narrow DenoiseModelId to the bundled models (rnnoise, speex). Coerce any retired persisted model value back to the default. - Fix General.tsx CI typecheck failures introduced by the denoise UI: restore three imports the rewrite deleted (useDateFormatItems, SequenceCardStyle, useTauriUpdater), add the missing denoise/sound imports, and correct hallucinated Folds props (Text has no variant/bold; Box uses alignItems/justifyContent). tsc now passes with 0 errors. - Harden the vite denoise plugin: required RNNoise/Speex/gate assets and the shim now fail the build loudly if missing (instead of a silent warn that shipped a broken ML feature), and the index.html shim injection is verified. - CI: move the cinny-desktop submodule bump into ci.yml as a `trigger-desktop` job gated on `needs: build`, and delete the standalone trigger-desktop.yml. A failing push no longer kicks off the slow Tauri builds in parallel. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-06-16 01:42:21 -04:00
jared	5d5f5f4516	feat(calls): implement advanced multi-model ML noise suppression system ... Implement a flexible, multi-model noise suppression pipeline for Element Call/LiveKit integration: - ML Engines: Added support for RNNoise, Speex, DTLN, and DeepFilterNet 3 models. - Pipeline Architecture: Implemented modular audio processing in lotus-denoise.js, supporting 'Series Suppression' (running browser-native NSNet2 before ML) and a hardware-style Noise Gate. - UI & UX Enhancements: - Settings UI: Added model comparison chart with CPU/Quality metadata. - Tuning: Added Live Microphone Meter for calibrating Noise Gate thresholds. - Reporting: Added LotusToast system to alert users when ML suppression fails or falls back to raw input. - Robustness & Quality: - Capture Fidelity: Removed forced 48kHz capture constraints to allow native-rate capture (solving static issues with high-end audio interfaces). - Performance: Added WASM SIMD detection with transparent fallback. - Capability Detection: Added browser feature detection to disable unsupported ML modes. - Build Integration: Updated Vite config to self-host all model WASM/tflite assets in /denoise/ directory.	2026-06-16 00:50:12 -04:00