Add KV-Cache compression ops#957

Ringssss wants to merge 2 commits intoInfiniTensor:mainInfiniTensor/InfiniCore:mainfrom

Ringssss:kv-compression-opsRingssss/InfiniCore:kv-compression-opsCopy head branch name to clipboard