File size: 1,873 Bytes
6f1d037 287dbf1 6f1d037 287dbf1 6f1d037 287dbf1 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 | ---
language:
- en
license: apache-2.0
pipeline_tag: text-generation
library_name: transformers
---
# SPARK: Adaptive Parametric Knowledge Participation for Faithful Retrieval-Augmented Generation
This repository contains the model checkpoints for **SPARK**, a lightweight framework designed to resolve knowledge conflicts in retrieval-augmented generation (RAG).
- **Paper:** [SPARK: Adaptive Parametric Knowledge Participation for Faithful Retrieval-Augmented Generation](https://huggingface.co/papers/2606.27786)
- **Repository:** [GitHub - OpenBMB/SPARK](https://github.com/OpenBMB/SPARK)
## Method Overview
SPARK is a lightweight framework that learns adaptive knowledge participation policies for faithful retrieval-augmented generation. With the backbone LLM frozen, its participation policy dynamically regulates layer-wise FFN contributions, determining when and to what extent parametric knowledge participates during generation. Optimized through faithfulness-guided reinforcement learning using response-level rewards, SPARK mitigates catastrophic forgetting and better preserves general generation capabilities compared to full-parameter supervised fine-tuning.
## Setup and Usage
Please refer to the official [GitHub Repository](https://github.com/OpenBMB/SPARK) for detailed environment setup, training, and evaluation scripts.
## Citation
If you find this work useful, please cite the paper:
```bibtex
@misc{li2026sparkadaptiveparametricknowledge,
title={SPARK: Adaptive Parametric Knowledge Participation for Faithful Retrieval-Augmented Generation},
author={Ruochang Li and Pengcheng Huang and Zhenghao Liu and Yukun Yan and Huiyuan Xie and Yu Gu and Ge Yu and Maosong Sun},
year={2026},
eprint={2606.27786},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2606.27786},
}
``` |