@inproceedings{tu-etal-2023-ssp,
    title = "{SSP}: Self-Supervised Post-training for Conversational Search",
    author = "Tu, Quan  and
      Gao, Shen  and
      Wu, Xiaolong  and
      Cao, Zhao  and
      Wen, Ji-Rong  and
      Yan, Rui",
    editor = "Rogers, Anna  and
      Boyd-Graber, Jordan  and
      Okazaki, Naoaki",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.findings-acl.837",
    doi = "10.18653/v1/2023.findings-acl.837",
    pages = "13237--13249",
    abstract = "Conversational search has been regarded as the next-generation search paradigm. Constrained by data scarcity, most existing methods distill the well-trained ad-hoc retriever to the conversational retriever. However, these methods, which usually initialize parameters by query reformulation to discover contextualized dependency, have trouble in understanding the dialogue structure information and struggle with contextual semantic vanishing. In this paper, we propose {pasted macro {`}FULLMODEL{'}} ({pasted macro {`}MODEL{'}}) which is a new post-training paradigm with three self-supervised tasks to efficiently initialize the conversational search model to enhance the dialogue structure and contextual semantic understanding. Furthermore, the {pasted macro {`}MODEL{'}} can be plugged into most of the existing conversational models to boost their performance. To verify the effectiveness of our proposed method, we apply the conversational encoder post-trained by {pasted macro {`}MODEL{'}} on the conversational search task using two benchmark datasets: CAsT-19 and CAsT-20.Extensive experiments that our {pasted macro {`}MODEL{'}} can boost the performance of several existing conversational search methods. Our source code is available at \url{https://github.com/morecry/SSP}.",
}

Conversational search has been regarded as the next-generation search paradigm. Constrained by data scarcity, most existing methods distill the well-trained ad-hoc retriever to the conversational retriever. However, these methods, which usually initialize parameters by query reformulation to discover contextualized dependency, have trouble in understanding the dialogue structure information and struggle with contextual semantic vanishing. In this paper, we propose {pasted macro {`}FULLMODEL{'}} ({pasted macro {`}MODEL{'}}) which is a new post-training paradigm with three self-supervised tasks to efficiently initialize the conversational search model to enhance the dialogue structure and contextual semantic understanding. Furthermore, the {pasted macro {`}MODEL{'}} can be plugged into most of the existing conversational models to boost their performance. To verify the effectiveness of our proposed method, we apply the conversational encoder post-trained by {pasted macro {`}MODEL{'}} on the conversational search task using two benchmark datasets: CAsT-19 and CAsT-20.Extensive experiments that our {pasted macro {`}MODEL{'}} can boost the performance of several existing conversational search methods. Our source code is available at \url{https://github.com/morecry/SSP}.
Tu, Quan Gao, Shen Wu, Xiaolong Cao, Zhao Wen, Ji-Rong Yan, Rui
SSP: Self-Supervised Post-training for Conversational Search