Commit acb947d
remove ALL tokenizers multiversions & upgrade the single remaining version to 0.22.2
Summary: Remove all versions of multi-versioned tokenizer (`[tokenizer-20, tokenizer-21, tokenizer-22]`) and upgrade default `tokenizer` to `0.22.2`
Reviewed By: dtolnay
Differential Revision: D89590447
fbshipit-source-id: 9905594de5a3dd7203380453104b6f9a5df414641 parent 16d8633 commit acb947d
2 files changed
+0
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
34 | 34 | | |
35 | 35 | | |
36 | 36 | | |
37 | | - | |
38 | 37 | | |
39 | 38 | | |
40 | 39 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
34 | 34 | | |
35 | 35 | | |
36 | 36 | | |
37 | | - | |
38 | 37 | | |
39 | 38 | | |
40 | 39 | | |
| |||
0 commit comments