Skip to content

[Question]: force_tokens for reproducing LLMLingua-2 on LongBench DataSet #228

Description

@TzuchengChang

Describe the issue

I would like to know whether all the results in the LLMLingua2 paper used force_tokens. I noticed that the repository has different force_tokens settings for different datasets, but not all datasets' force_tokens are displayed. If I want to reproduce the results from the LLMLingua2 paper, particularly for the LongBench dataset(21 subdatasets), how should force_tokens be configured?

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions