Skip to content

Commit ae8849e

Browse files
committed
add format
1 parent 84daa7c commit ae8849e

File tree

1 file changed

+10
-0
lines changed

1 file changed

+10
-0
lines changed

src/compressed_tensors/quantization/quant_scheme.py

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -142,6 +142,16 @@ def is_preset_scheme(name: str) -> bool:
142142
)
143143
)
144144

145+
MXFP4 = dict(
146+
weights=QuantizationArgs(
147+
num_bits=4,
148+
type=QuantizationType.FLOAT,
149+
strategy=QuantizationStrategy.GROUP,
150+
symmetric=True,
151+
dynamic=False,
152+
group_size=32
153+
)
154+
)
145155

146156
NVFP4 = dict(
147157
weights=QuantizationArgs(

0 commit comments

Comments
 (0)