Extend DeepSpeed inference initialization API with a 'quantize_groups' argument#3519
Open
sakogan wants to merge 7 commits into
Open
Extend DeepSpeed inference initialization API with a 'quantize_groups' argument#3519sakogan wants to merge 7 commits into
sakogan wants to merge 7 commits into