• DieMitchell released this 2026-10-05 04:11:09 +02:00 | 4 commits to main since this release

    Fixes grab + stick depth when SteamVR reserves the stick for its laser mouse and FrameYap application analog actions are inactive. FrameYap consumes smooth-scroll events from the grabbing controller as bounded depth movement, prefers a valid app axis, and applies each delta once. The UI does not scroll during a grab.

    Removes the idle microphone explanation from the bottom of Settings.

    Validation: all 32 desktop checks and 36 native Frame checks pass. The grab-depth correction also passed 73 Python tests. The wearer confirmed grab + stick works. Live counters accepted 895 controller-tagged scroll events and measured 0.735 m of depth travel, with zero redraws or uploads across 1,300 retained movement frames. Motion-loop work totaled 21.923 ms over 1,302 ticks (maximum 2.804 ms); rendering and upload totals are measured separately and are not motion-to-photon latency.

    The final ARM64 package is installed and running on the Frame. Its binary hash matches the release artifact, and the no-input Gamescope IME check passes. Profiling is disabled again.

    The archive includes the native application, SDL/OpenVR libraries, assets, font and licenses. Speech runtime and model install separately through the installer; existing installations are preserved.

    Downloads
  • DieMitchell released this 2026-10-05 03:53:48 +02:00 | 18 commits to main since this release

    Fixes the Parakeet Redux model-install HTTP 404 and includes the pending overlay improvements.

    • Repins Redux to the available upstream revision. Inference weights/config/tokenizer are unchanged. Previously verified model cards remain accepted, so existing installations need no model or runtime download.
    • Adds Settings → About, attended update checks, scrollable review/settings, saved wrist/head placement, and optional wrist world fallback.
    • Adds Open Draw and an 800 ms Open Keyboard hold to recenter. Animated backgrounds now default off and can be enabled in Settings.
    • Reuses initialized GPU textures throughout grab/scale. Stick depth follows the captured panel face normal and uses a separate hand-specific action set. Actual stick delivery remains dependent on SteamVR’s experimental overlay input permission and supported bindings.
    • Reports a missing DISPLAY when Type’s Xwayland focus guard cannot connect. SSH launches must use the verified session display; Steam/desktop launches inherit their session environment.
    • Keeps offline model-status queries from creating files in the installed release inventory.

    Validation: 73 Python tests, 32 desktop offline/UI CTest checks, and 36 native ARM64 CTest checks pass. The ARM64 archive was installed on Steam Frame; the installed binary hash, existing model verification, model provisioning, and no-input Gamescope IME discovery were checked. SDL/OpenVR resolve from the archive’s own lib directory. No microphone recording or text injection was performed by the checks. In-headset appearance, sustained movement comfort, and actual stick-axis delivery require the wearer’s verification.

    Update with the README’s one-command installer. Answer y to FrameYap, then n to model/runtime if they are already installed and working. Missing models can now be installed normally. The archive contains the native app, SDL3 and the OpenVR client library; the speech runtime and model remain separate explicit downloads. The previous installed version is retained for rollback.

    Downloads
  • DieMitchell released this 2026-10-04 07:33:43 +02:00 | 24 commits to main since this release

    First FrameYap release: on-device voice typing for Steam Frame.

    Install on the Frame (terminal or SSH):

    curl -fsSL https://github.com/baketnk/frame-yap/releases/latest/download/install.sh | sh
    

    The installer asks y/n to install FrameYap, download the Parakeet Redux speech model (~180 MB, CC-BY-4.0) and pip-install the CPU Python runtime (moondream/Kestrel + CPU Torch, ~200 MB download). No sudo or compiler. Launch FrameYap from the desktop application menu afterwards.

    The archive contains FrameYap, SDL3 3.2.16 (audio only) and the OpenVR 2.15.6 client library, built on a Steam Frame with scripts/build-release.sh. Kestrel, Torch, moondream and the model weights are not redistributed; they are downloaded on your machine.

    🤖 Generated with Claude Code

    Downloads