Project is not working with Nvidia GTX Series 10

[ManuEZ]

As the title says, when trying to use CUDA, it says that the version of PyTorch doesnt work with sm_61. It says that in order to properly work we need to use pytorch with cu126

The error is the following:

/app/whisperx-env/WhisperX/.venv/lib/python3.10/site-packages/torch/cuda/init.py:283: UserWarning:

Found GPU0 NVIDIA GeForce GTX 1070 Ti which is of cuda capability 6.1.

Minimum and Maximum cuda capability supported by this version of PyTorch is (7.0) - (12.0)

NVIDIA GeForce GTX 1070 Ti with CUDA capability sm_61 is not compatible with the current PyTorch installation.

The current PyTorch install supports CUDA capabilities sm_70 sm_75 sm_80 sm_86 sm_90 sm_100 sm_120.

If you want to use the NVIDIA GeForce GTX 1070 Ti GPU with PyTorch, please check the instructions at https://pytorch.org/get-started/locally/.

Please install PyTorch with a following CUDA configurations: 12.6

[rishikanthc]

This is a cuda compatibility issue. The current image uses cuda 12.9
I can release another image for older gpus.

[ManuEZ]

This is a cuda compatibility issue. The current image uses cuda 12.9 I can release another image for older gpus.

That would be awesome! I would really appreciate it, I tried to do it on my own but I couldn't :(. I'm a newbie 😅. Thanks so much!

[teije]

I would really really appreciate this as well!

I tried using a GTX 1070 and am now falling back to my CPU, but it takes forever to transcribe a 15 minute file.

[teije]

I have attempted to create an image with a lower cuda version, but I kept running into problems that I could not resolve myself.

@rishikanthc: If it is not too much work, could you release an image based on the lower cuda version?

[rishikanthc]

@ManuEZ @teije for sure. Currently I'm planning to publish 3 images for the next release: arm/amd64 cpu, a nvidia cuda-12.9 and a nvidia cuda-12.6

It would be great if you guys can confirm that cuda-12.6 will work with gtx 1080. If not let me know which is the latest cuda version that works with 1080 gpus

[ManuEZ]

@ManuEZ @teije for sure. Currently I'm planning to publish 3 images for the next release: arm/amd64 cpu, a nvidia cuda-12.9 and a nvidia cuda-12.6

It would be great if you guys can confirm that cuda-12.6 will work with gtx 1080. If not let me know which is the latest cuda version that works with 1080 gpus

@rishikanthc Yes, gtx 1080 is Compute Capability of 6.1, Arch Pascal, in other words, yes, cuda 12.6 would work for gtx 1080 as well

[teije]

@rishikanthc @ManuEZ Can confirm!

https://developer.nvidia.com/cuda-legacy-gpus

[rishikanthc]

@ManuEZ and @teije I have downgraded the base cuda image to use cudnn 12.6.3 instead of 12.9
It works fine on my RTX A5000 which is a newer card. So I guess I don't need to release 2 different cuda images.
Could one of you build the image from the main branch and test if it works for you ? Would be of great help.