Skip to content

Parallelize multi-chunk inference for ~3-4x speedup on multi-sentence text#147

Open
namanomar wants to merge 1 commit into
KittenML:mainfrom
namanomar:perf/onnx-inference-speedup
Open

Parallelize multi-chunk inference for ~3-4x speedup on multi-sentence text#147
namanomar wants to merge 1 commit into
KittenML:mainfrom
namanomar:perf/onnx-inference-speedup

Parallelize multi-chunk inference for ~3-4x speedup on multi-sentence…

3f5f17e
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs