perf: add FastBPETrainer using word-frequency counting#13

AmitMY wants to merge 1 commit into

mainsign-language-processing/complex-tokenization:mainfrom

perf/incremental-countingsign-language-processing/complex-tokenization:perf/incremental-countingCopy head branch name to clipboard