Skip to content

Commit 4033f31

Browse files
committed
enable fp4
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
1 parent 931df60 commit 4033f31

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/compressed_tensors/quantization/lifecycle/initialize.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -218,7 +218,7 @@ def initialize_qparams(
218218

219219
group_size = quantization_args.group_size
220220
num_groups = strategy_cdiv(observed_shape[-1], group_size, strategy)
221-
expected_shape = (*observed_shape[:-1], num_groups)
221+
expected_shape = (observed_shape[-2], num_groups)
222222

223223
# initialize activation ordering if applicable
224224
if actorder == ActivationOrdering.GROUP:

0 commit comments

Comments
 (0)