-
Notifications
You must be signed in to change notification settings - Fork 106
Description
Hi all,
I'm currently in the process of writing a video player that can generate subtitles from audio using whisper.cpp. My development machine is a 13-inch M2 macbook air running the asahi kernel and mesa driver (via nixos-apple-silicon), and I'm running into performance issues when running a whisper transcription using the Vulkan backend. The transcription runs much faster than I need it to be (around 7x realtime), but seems to eat up all the GPU's resources, causing the entire UI to become sluggish (mouse position updates like once-twice per second). I'm not sure if this issue lies in the Asahi GPU kernel driver, but I read online that scheduling GPU work on linux is the job of the kernel graphics driver, so I'm taking the liberty to post this issue here (sorry if this is the wrong place!)
Any help would be much appreciated! :)