Publications

Xinyu Wang, Bohan Zhuang, Qi Wu (2025). Are Large Vision Language Models Good Game Players?. arXiv.

Zizheng Pan, Jing Liu, Haoyu He, Jianfei Cai, Bohan Zhuang (2025). Stitched ViTs are Flexible Vision Backbones. Computer Vision – ECCV 2024.

Yuedong Chen, Haofei Xu, Chuanxia Zheng, Bohan Zhuang, Marc Pollefeys, Andreas Geiger, Tat-Jen Cham, Jianfei Cai (2025). MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-view Images. Computer Vision – ECCV 2024.

Yuetian Weng, Mingfei Han, Haoyu He, Xiaojun Chang, Bohan Zhuang (2025). LongVLM: Efficient Long Video Understanding via Large Language Models. Computer Vision – ECCV 2024.

Yefei He, Feng Chen, Jing Liu, Wenqi Shao, Hong Zhou, Kaipeng Zhang, Bohan Zhuang (2024). ZipVL: Efficient Large Vision-Language Models with Dynamic Token Sparsification. arXiv.

Yefei He, Feng Chen, Yuanyu He, Shaoxuan He, Hong Zhou, Kaipeng Zhang, Bohan Zhuang (2024). ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality. arXiv.

Pengcheng Chen, Jin Ye, Guoan Wang, Yanjun Li, Zhongying Deng, Wei Li, Tianbin Li, Haodong Duan, Ziyan Huang, Yanzhou Su, Benyou Wang, Shaoting Zhang, Bin Fu, Jianfei Cai, Bohan Zhuang, Eric J. Seibel, Yu Qiao, Junjun He (2024). GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI. Advances in Neural Information Processing Systems.

Zhuokun Chen, Jinwu Hu, Zeshuai Deng, Yufeng Wang, Bohan Zhuang, Mingkui Tan (2024). Enhancing Perception Capabilities of Multimodal LLMs with Training-Free Fusion. arXiv.

Mingyang Zhang, Jing Liu, Ganggui Ding, Xinyi Yu, Linlin Ou, Bohan Zhuang (2024). Channel Merging: Preserving Specialization for Merged Experts. arXiv.

Feng Chen, Chenhui Gou, Jing Liu, Yang Yang, Zhaoyang Li, Jiyuan Zhang, Zhenbang Sun, Bohan Zhuang, Qi Wu (2024). Evaluating and Advancing Multimodal Large Language Models in Ability Lens. arXiv.

Jing Liu, Ruihao Gong, Mingyang Zhang, Yefei He, Jianfei Cai, Bohan Zhuang (2024). ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models. arXiv.

Zizheng Pan, Bohan Zhuang, De-an Huang, Weili Nie, Zhiding Yu, Chaowei Xiao, Jianfei Cai, Anima Anandkumar (2024). T-Stitch: Accelerating Sampling in Pre-Trained Diffusion Models with Trajectory Stitching. arXiv.

Yefei He, Luoming Zhang, Weijia Wu, Jing Liu, Hong Zhou, Bohan Zhuang (2024). ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification. arXiv preprint arXiv:2405.14256.

Guoan Wang, Jin Ye, Junlong Cheng, Tianbin Li, Zhaolin Chen, Jianfei Cai, Junjun He, Bohan Zhuang (2024). SAM-Med3D-MoE: Towards a Non-Forgetting Segment Anything Model via Mixture of Experts for 3D Medical Image Segmentation. Medical Image Computing and Computer Assisted Intervention – MICCAI 2024.

Jing Liu, Ruihao Gong, Xiuying Wei, Zhiwei Dong, Jianfei Cai, Bohan Zhuang (2024). QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models. International Conference on Learning Representations (ICLR).

Haoyu He, Jianfei Cai, Jing Liu, Zizheng Pan, Jing Zhang, Dacheng Tao, Bohan Zhuang (2024). Pruning self-attentions into convolutional layers in single path. IEEE transactions on pattern analysis and machine intelligence.

Zhen Yang, Ganggui Ding, Wen Wang, Hao Chen, Bohan Zhuang, Chunhua Shen (2024). Object-Aware Inversion and Reassembly for Image Editing. The Twelfth International Conference on Learning Representations.

Yuedong Chen, Chuanxia Zheng, Haofei Xu, Bohan Zhuang, Andrea Vedaldi, Tat-Jen Cham, Jianfei Cai (2024). MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Views. Advances in Neural Information Processing Systems (NeurIPS).

Zeyu Zhang, Akide Liu, Ian Reid, Richard Hartley, Bohan Zhuang, Hao Tang (2024). Motion mamba: Efficient and long sequence motion generation. European Conference on Computer Vision.

Xinyu Wang, Bohan Zhuang, Qi Wu (2024). Modaverse: Efficiently transforming modalities with llms. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Akide Liu, Jing Liu, Zizheng Pan, Yefei He, Reza Haffari, Bohan Zhuang (2024). Minicache: Kv cache compression in depth dimension for large language models. Advances in Neural Information Processing Systems.

Yefei He, Jing Liu, Weijia Wu, Hong Zhou, Bohan Zhuang (2024). EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models. International Conference on Learning Representations.

Haoyu He, Zizheng Pan, Jing Liu, Jianfei Cai, Bohan Zhuang (2024). Efficient stitchable task adaptation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Xinyu Wang, Bohan Zhuang, Qi Wu (2023). SwitchGPT: Adapting Large Language Models for Non-Text Outputs. arXiv.

Jing Liu, Jianfei Cai, Bohan Zhuang (2023). Sharpness-aware Quantization for Deep Neural Networks. arXiv.

Zizheng Pan, Jianfei Cai, Bohan Zhuang (2023). Stitchable neural networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Jing Liu, Bohan Zhuang, Peng Chen, Chunhua Shen, Jianfei Cai, Mingkui Tan (2023). Single-path bit sharing for automatic loss-aware model compression. IEEE Transactions on Pattern Analysis and Machine Intelligence.

Haoyu He, Jianfei Cai, Jing Zhang, Dacheng Tao, Bohan Zhuang (2023). Sensitivity-aware visual parameter-efficient fine-tuning. Proceedings of the IEEE/CVF International Conference on Computer Vision.

Yefei He, Luping Liu, Jing Liu, Weijia Wu, Hong Zhou, Bohan Zhuang (2023). PTQD: Accurate Post-Training Quantization for Diffusion Models. Advances in Neural Information Processing Systems.

Yuetian Weng, Mingfei Han, Haoyu He, Mingjie Li, Lina Yao, Xiaojun Chang, Bohan Zhuang (2023). Mask propagation for efficient video semantic segmentation. Advances in Neural Information Processing Systems.

Haoyu He, Jing Zhang, Bohan Zhuang, Jianfei Cai, Dacheng Tao (2023). End-to-end one-shot human parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence.

Zeshuai Deng, Zhuokun Chen, Shuaicheng Niu, Thomas Li, Bohan Zhuang, Mingkui Tan (2023). Efficient test-time adaptation for super-resolution with second-order degradation and reconstruction. Advances in Neural Information Processing Systems.

Haoyu He, Jianfei Cai, Zizheng Pan, Jing Liu, Jing Zhang, Dacheng Tao, Bohan Zhuang (2023). Dynamic focus-aware positional queries for semantic segmentation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition.

Yefei He, Zhenyu Lou, Luoming Zhang, Jing Liu, Weijia Wu, Hong Zhou, Bohan Zhuang (2023). Bivit: Extremely compressed binary vision transformers. Proceedings of the IEEE/CVF International Conference on Computer Vision.

Bohan Zhuang, Jing Liu, Zizheng Pan, Haoyu He, Yuetian Weng, Chunhua Shen (2023). A survey on efficient training of transformers. Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence.

Zizheng Pan, Peng Chen, Haoyu He, Jing Liu, Jianfei Cai, Bohan Zhuang (2022). Mesa: A Memory-saving Training Framework for Transformers. arXiv.

Jing Liu, Jianfei Cai, Bohan Zhuang (2022). FocusFormer: Focusing on What We Need via Architecture Sampler. arXiv.

Zizheng Pan, Bohan Zhuang, Haoyu He, Jing Liu, Jianfei Cai (2022). Less is more: Pay less attention in vision transformers. Proceedings of the AAAI conference on artificial intelligence.

Zizheng Pan, Jianfei Cai, Bohan Zhuang (2022). Fast vision transformers with hilo attention. Advances in Neural Information Processing Systems.

Jing Liu, Zizheng Pan, Haoyu He, Jianfei Cai, Bohan Zhuang (2022). Ecoformer: Energy-saving attention with linear complexity. Advances in Neural Information Processing Systems.

Changlin Li, Bohan Zhuang, Guangrun Wang, Xiaodan Liang, Xiaojun Chang, Yi Yang (2022). Automated progressive learning for efficient training of vision transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Yuetian Weng, Zizheng Pan, Mingfei Han, Xiaojun Chang, Bohan Zhuang (2022). An Efficient Spatio-Temporal Pyramid Transformer for Action Detection. Computer Vision – ECCV 2022.

Zizheng Pan, Bohan Zhuang, Jing Liu, Haoyu He, Jianfei Cai (2021). Scalable vision transformers with hierarchical pooling. Proceedings of the IEEE/cvf international conference on computer vision.

Chunlei Liu, Peng Chen, Bohan Zhuang, Chunhua Shen, Baochang Zhang, Wenrui Ding (2021). SA-BNN: State-aware binary neural network. Proceedings of the AAAI Conference on Artificial Intelligence.

Peng Chen, Bohan Zhuang, Chunhua Shen (2021). FATNN: Fast and accurate ternary neural networks. Proceedings of the IEEE/CVF International Conference on Computer Vision.

Bohan Zhuang, Mingkui Tan, Jing Liu, Lingqiao Liu, Ian Reid, Chunhua Shen (2021). Effective training of convolutional neural networks with low-bitwidth weights and activations. IEEE Transactions on Pattern Analysis and Machine Intelligence.

Jing Liu, Bohan Zhuang, Zhuangwei Zhuang, Yong Guo, Junzhou Huang, Jinhui Zhu, Mingkui Tan (2021). Discrimination-aware network pruning for deep model compression. IEEE Transactions on Pattern Analysis and Machine Intelligence.

Peng Chen, Jing Liu, Bohan Zhuang, Mingkui Tan, Chunhua Shen (2021). Aqd: Towards accurate quantized object detection. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition.

Bohan Zhuang, Chunhua Shen, Mingkui Tan, Lingqiao Liu, Ian Reid (2019). Structured binary neural networks for accurate image classification and semantic segmentation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition.