PQCache: Product Quantization-based KVCache for Long Context LLM Inference

Hailin Zhang, Xiaodong Ji, Yilin Chen,Fangcheng Fu,Xupeng Miao,Xiaonan Nie, Weipeng Chen,Bin Cui

CoRR(2024)

引用 0|浏览23
暂无评分
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要