Minicache: Kv cache compression in depth dimension for large language models

Akide Liu, Jing Liu, Zizheng Pan, Yefei He, Reza Haffari, Bohan Zhuang
January 2024
Cite URL
Type
Journal article
Publication
Advances in Neural Information Processing Systems