Benchmark against Rust library #46

Open

opened

We should benchmark agaisnt https://github.com/huggingface/tokenizers

I don't expect for us to win, but it gives us a line to target against.

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests