@inproceedings{nguyen-duc-etal-2023-class,
    title = "Class based Influence Functions for Error Detection",
    author = "Nguyen-Duc, Thang  and
      Thanh-Tung, Hoang  and
      Tran, Quan Hung  and
      Huu-Tien, Dang  and
      Nguyen, Hieu  and
      T. V. Dau, Anh  and
      Bui, Nghi",
    editor = "Rogers, Anna  and
      Boyd-Graber, Jordan  and
      Okazaki, Naoaki",
    booktitle = "Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.acl-short.104",
    doi = "10.18653/v1/2023.acl-short.104",
    pages = "1204--1218",
    abstract = "Influence functions (IFs) are a powerful tool for detecting anomalous examples in large scale datasets. However, they are unstable when applied to deep networks. In this paper, we provide an explanation for the instability of IFs and develop a solution to this problem. We show that IFs are unreliable when the two data points belong to two different classes. Our solution leverages class information to improve the stability of IFs.Extensive experiments show that our modification significantly improves the performance and stability of IFs while incurring no additional computational cost.",
}

Influence functions (IFs) are a powerful tool for detecting anomalous examples in large scale datasets. However, they are unstable when applied to deep networks. In this paper, we provide an explanation for the instability of IFs and develop a solution to this problem. We show that IFs are unreliable when the two data points belong to two different classes. Our solution leverages class information to improve the stability of IFs.Extensive experiments show that our modification significantly improves the performance and stability of IFs while incurring no additional computational cost.
Nguyen-Duc, Thang Thanh-Tung, Hoang Tran, Quan Hung Huu-Tien, Dang Nguyen, Hieu T. V. Dau, Anh Bui, Nghi
Class based Influence Functions for Error Detection