llama : enforce the same K and V cache types for DeepSeek V4; enable FA if V cache is quantized - #25871
Open
fairydreaming wants to merge 3 commits into
Open
llama : enforce the same K and V cache types for DeepSeek V4; enable FA if V cache is quantized#25871fairydreaming wants to merge 3 commits into
fairydreaming wants to merge 3 commits into
background
wait
wait-all
cancel
parallel
Loading