Skip to content

Commit 3150cea

Browse files
committed
update
1 parent ae8849e commit 3150cea

File tree

1 file changed

+11
-3
lines changed

1 file changed

+11
-3
lines changed

src/compressed_tensors/quantization/quant_scheme.py

Lines changed: 11 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -148,9 +148,17 @@ def is_preset_scheme(name: str) -> bool:
148148
type=QuantizationType.FLOAT,
149149
strategy=QuantizationStrategy.GROUP,
150150
symmetric=True,
151-
dynamic=False,
152-
group_size=32
153-
)
151+
dynamic=False,
152+
group_size=32,
153+
),
154+
input_activations=QuantizationArgs(
155+
num_bits=4,
156+
type=QuantizationType.FLOAT,
157+
strategy=QuantizationStrategy.GROUP,
158+
dynamic=True,
159+
symmetric=True,
160+
group_size=32,
161+
),
154162
)
155163

156164
NVFP4 = dict(

0 commit comments

Comments
 (0)