Skip to content

Quantization support #3

Open
Open
Quantization support#3
Labels
enhancementNew feature or requesthelp wantedExtra attention is needed
@dreaming-panda

Description

@dreaming-panda
dreaming-panda
opened on Jan 14, 2025
  • GPTQ
  • bitsandbytes
  • FP8
  • FP4 (future in 50 series)

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is needed

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions