Is your feature request related to a problem? Please describe.
autoGPTQ repo is migrating to GPTQModel.
Describe the solution you'd like
update the dependencies and make sure compatibility.
Describe alternatives you've considered
might be ok to stay on obsoleted dependency (auto_gptq) until upstream/downstream stack reports issues. but new repo also has more model supports, which could reduce redundant works for us.
Additional context
need to make sure compatibility for granite family.
Is your feature request related to a problem? Please describe.
autoGPTQ repo is migrating to GPTQModel.
Describe the solution you'd like
update the dependencies and make sure compatibility.
Describe alternatives you've considered
might be ok to stay on obsoleted dependency (auto_gptq) until upstream/downstream stack reports issues. but new repo also has more model supports, which could reduce redundant works for us.
Additional context
need to make sure compatibility for
granitefamily.